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iBSTRACT 

This document presents the National Center for Higher 
Education Management Systems' (NCHEHS) faculty activity survey 
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What is the effect of each of these in the resulting data? Some of 
the larger issues surrounding a faculty activity analysis are 
discussed. These include (1) the question of the accuracy and 
consistency of faculty activity information; (2) the effect that 
altering the survey instrument has upon the resulting data; and (3) 
the general question of faculty acceptance of an activity survey. 
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ABSTRACT 



The Faculty Activity Analysis: Procedures Manual presents the National 
Center for Higher Education Management Systems' (NCHEMS) faculty activity 
survey instrument and discusses the procedural questions involved in con- 
ducting an activity survey. Recommended procedures are given where 
appropriate. Some of the concerns confronting an institution that is 
initiating an activity survey are identified and discussed, such as: 
when the survey should be conducted, should the institution sample faculty 
or conduct a census, what should be the survey time period, what are the 
alternative methods of administering the survey, and what is the effect 
of each of these in the resulting data. 

Some of the larger issues surrounding a faculty aci!:ivity analysis are 
discussed. These include (1) the question of the accuracy and con- 
sistency of faculty activity information, (2) the effect that altering 
the survey instrument has upon the resulting data, and (3) the general 
question of faculty acceptance of an activity survey. 



WARRANTY 



The Faculty Activity Analysis: Procedures Manual has been developed by 
the Faculty Activity Analysis (FAA) Task Force and the FAA pilot test 
^ institutions in conjunction with Charles Manning and Leonard Romney of 
the NCHEMS staff. Several consultants were also involved in the project 
prior to the formation of the task force. 

This manual represents one of three publications that are being developed 
over a two-year period by the Faculty Activity Analysis project. 

The procedures manual is intended to aid. institutions in conducting a 
faculty activity analysis which can be used for internal management 
purposes as well as in support of the Cost-Finding Principles (CFP) 
and Information Exchange Procedures (lEP) projects. This manual does 
no'C present specific costing procedures but rathe displays a manage- 
ment tool that could be used to support a wide variety of different 
procedures. Specific costing procedures that utilize faculty activity 
information will be defined by the CFP and lEP projects. 

The manual makes recommendations about the design of a survey instrument 
and the procedures for conducting a vacuity activity survey. The^^a 
recommendations should not be considered as standards; they are guide- 
lines for institutions and should be adapted to the particular needs of 
an institution. The users are also cautioned that using the recommended 
procedure does not insure comparability of the resulting data among 
institutions , 

ERIC vii 



This document has been reviewed and approved for publication by 
the staff and Technical Council of the National Center for Higher 
Education Management Systems at WICHE, This publication does not 
necessarily reflect official positions or policies of the National 
Institute of Education, NCHEMS, or WICHE. 
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SECTION I 
INTRODUCTION 



General 

Institutions of higher education have widely differing missions; 
they employ different techniques to accomplish these missions, and 
they are organized and guided to impact upon widely differing con- 
stituents. Some concentrate solely on expanding the capabilities 
of their students, others are primarily research oriented; some 
adhere to a traditional lecture and laboratory pedagogy, others 
employ a variety of media or extra-campus activity; some serve only 
formally matriculated students, others mingle in public affairs or 
act as repositories for new ideas and developments for industry. 

Though the variety of missions, activities, and constituencies that 
characterize the academic community is immense, each individiial 
institution relies to a great extent on its faculty to motivate 
students, transfer knowledge, and/or perform research. It is upon 
the collective shoulders of each institution's faculty that the 
primary burdens of instruction, research, and public service fall. 
Because faculty have such an important role in higher education 
institutions, it is vital that an institution understand the 
allocation of faculty time to different institutional programs. 
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This allocation has far-reaching implications on the institution's 
ability to perform its designated missions. 
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B. Purpose of a Faculty Activity Analysis 



The NCHEMS Faculty Activity Analysis (FAA) survey instrument, instruc- 
tions, definitions, and procedures were developed by members of the 
FAA Task Force, NCHEMS' staff, selected consultants, and representa- 
tives of the institutions where the instrument and associated pro- 
cedures were pilot tested. 

Originally, the FAA Task Force was asked to develop and test an 
instrument and the procedures for collecting faculty activity data 
for use In costing. The faculty activity information was to be used 
as a basis for distributing faculty compensation to appropriate 
elements of a standard cost center structure. The original intent 
was for the FAA project to support the Cost Finding Principles (CFP) 
project and, subsequently, the Information Exchange Procedures (lEP) 
project. 

As the task force members collectively considered their charge, 
they agreed they should attempt to develop an instrument that not 
only would meet requirements for program costing but also would be 
useful in the context of a number of other important management 
functions. The position of the task force is that data pertaining 
to faculty activities, though useful and important for program- 
costing purposes, have equal utility for long-range planning, 
budgeting, and program review and evaluation purposes. 
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The four general purp^sf-f. of a facuHy activity analysis drv out- 
lined below: 

!• Costing. ; Faculty compensation can be distributed to institu- 
tional programs in accordance with the time faculty spend 
working in each program. 

2. Planning and Management : An institution can study the impact 
of alternative assumptions such as higher teaching loads or 
decreased research funding on faculty activity patterns. 

3. Institutional Research Studies : The faculty activity infor- 
mation provides a data base for further studies on what faculty 
do and how their activities influence the outcomes of an 
institution's programs. 

4. External Reporting : A faculty activity survey is a source of 
information for reporting faculty workloads and faculty infor- 
mation to various funding sources. 
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C, NCHEMS' Faculty Activity Analysis Project and Publications 



The Faculty Activity Analysis project has been guided by a 
task force composed of faculty and administrative representatives. 
The task force reviewed the work that institutions had done in the 
area of faculty activity and developed a survey instrument and a 
set of procedures that attempted to incorporate the better features 
of other surveys. NCHEMS' effort is not intended to be a final 
statement on how to conduct a faculty activity survey, but 
rather should serve as a starting point for continuing work. 

NCHEMS' efforts in the area of faculty activity analysis have 
been documented in the following publications: 

Faculty Activity Analysis: Overview and Major Issues 
(Technical Report 24, pubT 5hed in December 1971)-- 
discusses the principal pnAlems and concerns in con- 
ducting a faculty activity ^.nalysis and reviews the 
work done in the field. 

Faculty Activity Analysis: Procedures Manual (this 
document)--discusses the survey instrument used in 
collecting faculty activity data and the procedures 
used in conducting a survey. 
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Faculty Activity Analysis: Interpretation and Uses of Data 
(to be published in the fall of 1973)--di scusses how faculty 
activity data can be organized and analyzed to provide mean- 
ingful management information. 

FAA Software (to be distributed early in 1974)--provides a 
mechanism for assisting in the analysis of faculty activity 
data. 

The implementation of a faculty activity analysis involves four stages 
as displayed in Figure 1. An institution planning to perform an 
analysis of faculty activity will need to resolve institutional con- 
cerns at each stage and develop a faculty activity analysis implemen- 
tation plan appropriate to its own institutional setting. 

The application of FAA documents. Figure 2, gives an NCHEMS' FAA 
publication reference for each stage of implementation of a faculty 
activity analysis. As an institution develops its own implementation 
plan for analysis of faculty activity, it can consult these publica- 
tions as needed. The documents are most helpful in stages II and IV. 
The implementation activities of stages I and III are highly dependent 
on the purposes of the analysis, the institutional setting, the role 
of faculty in the institution, and other factors. For this reason, 
while general considerations are outlined in the NCHEMS reference 
cited, no specific recommendations for these stages are given. 
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FIGURE 1 

IMPLEMENTATION OF A FACULTY ACTIVITY ANALYSIS 
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Each of the stages of the implementation process involves a great 
number of institutional decisions. The four supporting documentation 
manuals provide general guidelines and pose alternative procedures; 
they present examples but cannot answer all institutional concerns. 

One significant contribution of these manuals is the organization and 
identification of institutional concerns. With the NCHEMS references, 
decision makers can better anticipate what is' involved in a faculty 
activity analysis. 

FIGURE 2 

THE APPLICATION OF FAA DOCUMENTS 

REFERENCE 



FAA: Overview and Major Issues 



FAA: Procedures Manual 

FAA: Procedures Manual 

FAA: Interpretation and Uses of Data 
(to be completed in the fall of 1973) 

FAA Software Documentation 



No standard methodology is given but 
some considerations are discussed in 
the procedures manual 



FAA: Interpretation and Uses of Data 
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Review survey instruments 
Review survey procedures 
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Evaluate the collected data 
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This manual was reviewed and approved by the Faculty Activity Analysis 
Task Force, the NCHEMS staff, and the Technical Council; it has been 
sent to all NCHEMS participating institutions and agencies. It is 
being released as an implementation manual and no further revisions 
are planned at this time. 
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SECTION II 
THE SURVEY INSTRUMENT 



Overview of the Form 

NCHEMS' FAA form (see Appendix A) serves to collect information about 
the time faculty devoted to various activities, the perceived outcomes 
of these activities, and the budgetary accounts that support each 
activity. To serve this function requires that the form have certain 
characteristics. The following discussion outlines several of these 
characteristics and further elaborates on the capabilities of the 
form. 

1. The categories of activities have been designed to cover the 
so-called "full professional life" of the faculty member who is 
completing the form. The categories are intended to be descrip- 
tive and inclusive of everything that faculty do in a professional 
vein, from formal instruction through research and including 
consulting activities. Note that this characteristic does not 
imply that all of the time devoted to this full range of activities 
will constitute the basis for costing institutional programs. 
A technique has been built into the instrument that allows 
certain activities and the time devoted to them to be excluded 
from the costing base (see Section II E, Ficcal Reference 
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2. 



3. 
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Column and Block). The specific activity categories are defined 
and described on pages 14 through 31 of this manual. 

Time devoted to each of the several categories of activities is 
requested in terms of "average hours per week" during each period 
(academic term, academic year, fiscal year). This is discussed 
in more detail on pages 32 through 34. 

The survey instrument, when implemented in its complete form, 
includes the capability for the "respondees" to indicate how 
they think their activities relate to general institutional 
outcomes or objectives. Three rather broad aggregations of 
outcomes and a combination thereof are included on the form. 
These are: 

—student growth and development 
"development of new knowledge and art forms 
—community service and development 
— inseparable combinations (of the above). 

These outcome categories have been included to (1) allow the 
faculty member responding to indicate that his/her activities 
impact on multiple institutional outcomes (admittedly broad), 
(2) allow institutions to investigate the "joint product" 
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issue in more detail, and (3) to initiate a first step into 
the area of process/outcome analysis. These outcome categories 
are explained in more detail on pages 35 through 37. 

The "special fiscal reference block and column" are techniques 
built into the form that permit department chairmen or other 
appropriate receivers of the completed survey instrument to 
record financial information (account numbers, compensation, 
full-time equivalency) for the individual's appointment and then 
link this Information to the activities that are engaged in. 
Moreover, the capability has also been included to allow the 
receiver to make distinctions between those activities that 
are considered to be reimbursable or paid for by the institution 
and those that are not. It is this capability that permits the 
use of activity categories describing the "full professional 
life" to be used on a form that is intended to support program 
costing activities at the institution. See pages 38 througti 47 
for a more detailed explanation and definition of the codes 
recommended in the special fiscal reference block and column. 

The survey instrument and associated instructions avail the user 
of multiple levels of detail and emphasis. For example, with 
regard to emphasis, although the form is designed and written 
in terms of activity analysis (time devoted to activities), it 
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can be used (with only minor modifications) as a form for record- 
ing faculty assignments. 

With regard to level of detail, the categories of activities on 
the instrument can be used without further delineation and, when 
used for costing programs, can be related to (and "crossed over") 
in a conventional manner to elements of the standard cost center 
structure being used in other NCHEMS projects. See the FAA: 
Interpretation and Uses of Data for further explanation of this 
characteristic. 

By way of a general comment, the reader should note that the 
survey instrument should be regarded as a prototype, capable 
of substantial modification to meet unique institutional require- 
ments. Note also, however, that the FAA procedures are designed 
to support the costing aspects of the Information Exchange 
Procedures project. Thus, institutions participating in NCHEMS- 
designed information exchanges ouyht not to modify the FAA 
activity categories, definitions, or procedures of the instrument 
to such an extent that they are no longer compatible with the 
original FAA package. 
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Activity Categories 



In developing NCHEMS' Faculty Activity Analysis survey instrument, 
the task force reviewed instruments developed at different institu- 
tions and found a great similarity among sets of activity categories 
on different instruments. This is not surprising because the range 
of faculty activities is similar in most ini;ti tutions. Similarly, 
there is a striking resemblance between activity categories on the 
NCHEMS form and those developed for other institutions. 

In developing the activity categories of the survey instrument, 
efforts were made to keep the categories (1) general enough to fit 
many types of institutions, (2) extensive enough to enable faculty to 
easily list all their professional activities, and yet (3) not so 
extensive that it becomes cumbersome for faculty to complete. Other 
survey instruments have used very constrained activity lists (i.e., 
instruction, research, and institutional support) or have made use 
of look-up tables where a great many types of activities are listed. 
NCHEMS' instrument makes use of both of these features by using 
a relatively constrained set of activity categories but listing 
examples of many types of activities that would fall into each of the 
categories. Some faculty response to these categories can be found 
in Appendix B. 
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The remaining pages of Section TI, Part B, describe each of the activity 

categories, explain what additional data are requested, and give some 

specific examples of the types of activities that should be included 
in each category • 

1 . A.l, Scheduled Teaching 

FIGURE 3 

ACTIVITY CATEGORY: A.l, SCHEDULED TEACHING 
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The scheduled teaching category is used to record all faculty 
activity that is directly related to courses. These courses 
may be degree or non-degree related, credit or non-credit, day 
or evening, part of the regularly assigned teaching, or over- 
load teaching for night school. 

For each course taught, certain additional information (columns 
[a] through [g]) is also helpful in characterizing the type of 
activity. This information can be directly requested of faculty 
or pre-i:rinted on the data collection form prior to the distribu- 
tion to the faculty. Pre-printing columns (a) through (g) makes 
the completion of the survey instrument easier for the faculty 
and insures internal data consistency for the institution. If 
the information is not pre-printed, the enrollments, credit 
hours, and contact hours will in some cases be inconsistent 
with institutional records. This may be due to the faculty 
member's misinterpretation of the requested information, 
inaccurate records of the institution, or because the institu- 
tional records reflect the classroom situation at a different 
point in time than when the faculty activity survey was conducted. 

The following paragraphs define the elements of information 
requested in columns (a) through (i). 
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HEGIS: This column can be used to assign Higher Education 
General Information (HEGIS) discipline codes to each of 
the courses. This column is necessary only if an institution 
wishes to computer-assign Program Classification Structure 
(PCS) codes to each of the reported activities. (The FAA: 
Interpretation and Uses of Dat a will discuss how PCS codes 
are assigned. ) 

Department/Unit: This column is used to record the institu- 
tional name or number that distinguishes the department or 
unit in which the course is taught. 

Course and Section Number: This column is used to record 
the institutionally assigned course and section number; a 
separate line is used for each section taught. If the insti- 
tution distinguishes between course levels, the level code 
must be part of the course or section number or be included 
as a separate code in this column. 

Section: These columns include the headcount enrollment of 
the section and a code designation: remedial (considered by 
the institution to be below college level), or extension 
(principally directed toward non-matriculated students). The 
remedial and extension designations are included for the 
institution's benefit to insure that there is a mechanism 
for distinguishing remedial and extension courses. This 
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distinction is necessary if an institution wishes to assign 
NCHEMS' Program Classification Structure (PCS) codes to 
courses (see the FAA: Interpretation and Uses of Data for PCS 
coding conventions). If the institution has another mechanism 
for distinguishing these courses, or if it chooses not to 
assign PCS codes to courses, then this column is unnecessary. 

Credit Hours: This column is used to enter the credit hours 
received by the student for successfully completing the 
course. The completion of this column is relatively easy 
except for courses that offer variable credit and for courses 
that are taught jointly. 

The method of completing this column in these two situations 
is dependent on how the institution wishes to use the result- 
ing data. If the data are used to determine the credit hours 
generated by faculty, the credit hours recorded in this block 
must reflect partial credit for jointly-taught courses and 
average credit for variable-taught courses. The FAA Task 
Force does not believe that faculty should be asked to make 
these adjustments. If the data from the faculty activity 
survey is used in this way, this information should be pre- 
printed on the data collection form prior to distribution to 
faculty, and the instructions in the survey instrument must 
be modified to explain the adjustments. 
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Method of Instruction: This column is used to enter a code 
designating the method of instruction. The suggested list 
of instruction methods appears below. Modifications to this 
list are recommended if these methods are not consistent 
with the methods in use at the institution. The faculty 
member who is completing the instrument should be encouvaged 
to enter all methods of instruction used in the course, but 
those methods that are used more often should be listed first. 
The ordering of the methods allows the institution to more 
easily characterize the courses when the data is analyzed. 



METHOD OF INSTRUCTION 



;ode 



Method 



Definition 



A 
B 
C 
D 
E 
F 
G 



Lecture 



Laboratory 



Recitation/ 
Discussion 

Seminar 



Independent 
Study 

Tutorial 



Progrcimmed 
Instruction 



Formal presentation--primarily 
one-way communication 

Instructing, preparing, and 
supervising student investigations 

Two-way communication of course 
materials 

Students carry the major respon- 
sibility for preparation 

Students work independently with 
only minimal faculty direction 

Students work one-to-one with 
the instructor 

Course contents presented through 
programmed materials 
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g. Formal Contact Hours: This column is used to enter the 
number of formally scheduled faculty contact hours per 
week for each course. Faculty who share the responsibility 
for a course should enter the average formal contact 
hours per week in the term that they spend with the class. 
If they attend all scheduled classes and the class meets 
three hours per week they should enter "3." If they 
attend only half the classes they should enter "1.5." 

h. Other Contact Hours: This column is used to enter the 
average hours per week of unscheduled faculty contact 
with students in each course. This would include time 
spent with students before and after class and the office 
hours spent in helping students with course-related 
material . This column should not reflect time spent in 
category C.l, Career Counseling, or A. 3, Academic Program 
Advising. 

i. Preparation and Administration Time: This column is used 

to enter the average hours per week spent in grading papers, 
preparing lectures, evaluating students, arranging for guest 
lectures, and setting up and preparing audio-visual materials 
for current courses^ The time should be reported as average 
hours per week. The time spent in preparing for future 
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courses is not included here but rathei* in category A. 4, 
Course and Curriculum Research and Development. 

A.2> Unscheduled Teaching 

This category includes those teaching activities that are not 
associated with specific courses (see Figure 4). For example: 

—guest lecturing for another faculty member 
—thesis advising 

—discussions with colleagues about teaching 

—thesis committee participation 

—giving colloquia within the institution. 

Where possible, the levels of the students receiving this 
instruction should be indicated in column (p). The following 
is a suggested list of levels and codes. If these are not appro- 
priate in a particular institution, a more appropriate list should 
be substituted. 
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A Preparatory 

B Lower Division (Freshman, Sophomore) 
C Upper Division (Junior, Senior) 
D Undergraduate (Freshman - Senior) 
E Upper Division and Graduate 
F Graduate - Professional (Students) 
G Other 

In the activity description column (q) the faculty member 
briefly describes the type of activity. This description is 
very useful to the department or unit administrator when 
reviewing the faculty's activities (see Section II E). 

FIGURE 4 ^ 
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3. 



A. 3, Academic Program Advising 



This category includes helping or advising students concerning: 
—what courses to take 

—course requirements for a particular program 
—scheduling the necessary courses 
—program standards. 

This category does not include personal or career guidance; 
these activities are included in C.l, Student-oriented Service. 
The level and activity description columns are used as described 
in category A. 2, Unscheduled Teaching Activities. 

4. A.4> Course and Curriculum Research and Development 

This category is used to record the time spent in planning future 
courses and designing future curriculum requirements. The follow- 
ing activities should be included: 

--planning future courses 

—revising old and designing new instructional material 
--selecting texts 

—evaluating courses in order to improve them 
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—planiiing summer or inter-session programs 
--developing new curriculum requirements. 

The level and activity description columns are used as described 
in category A. 2. 

FIGURE 5 

ACTIVITY CATEGORIES INCLUDED IN 
B.l, RESEARCH SCHOLARSHIP; AND B.2, CREATIVE WORK ACTIVITIES 
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5. B,l , Specific Projects 

Research, scholarship, and creative work activities that are 
related to a specific project are recorded in this section. This 
category is intended for all faculty activities that involve the 
practice of a research-, scholarship-, or creative work-related 
skill. Activities that do not involve practicing that skill 
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but that are nonetheless related to professional development 
are included in category B,2, General Scholarship and Professional 
Development. Practice of the professional skill is the chief 
distinction made between these activity categories; no c roe 
of funds distinction is made. 

The source of funds question is resolved by making use of the 
fiscal reference column which links each faculty activity to a 
budgetary account* (See page 38 for a discussion of the fiscal 
reference colunin, ) 

The following are some examples of activities in B.l, Specific 
Projects. 

--departmental research (specific projects) 

— sponsored research (specific projects) 

--securing new grants 

--performing your professional skill 

—writing or developing researcli programs 

--administering research grants 

—giving recitals 

—completing your dissertation research 
--writing or revising books 
--writing articles 
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—writing reviews 

—creating new art forms 
—exhibiting your work 
—practicing an artistic skill 
—reviewing a colleague's research work. 

B. 2> General Scholarship and Professional Development 

This category is for reporting the time spent in keeping current 
in a professional field: 

—reading articles and books related to profession 
—attending professional meetings 
—research-related discussion with colleagues 
—editing a journal or book 
—officer in a professional society. 

C. l> Student-Oriented Service 

This category is for reporting time spent in general contact with 
or service to students. The following activities would be included 
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--personal, career, and financial counseling of students 

--preparing student recommendations 

--participating in social interaction with students 

--sponsoring student organizations 

--meeting parents of students 

—participating in student programs 

—coaching intercollegiate or intramural athletics 

—directing the band, orchestra, plays, debate team, or other 
student groups when not formally organized courses, 

FIGURE 6 

ACTIVITY CATEGORIES INCLUDED 
IN C: STUDENT-ORIENTED SERVICE, C.l; 
ADMINISTRATIVE DUTIES, C.2; AND COMMITTEE PARTICIPATION, C,3 
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8. C,2> Administrative Duties 



All administrative duties other than those directly related to 
courses or research should be included in this category. 

—performing the duties of dean, department chairman, vice 
president, or any other administrative position 

--administering department subunits 

—administering or working in non-academic units as the 
library, registrar's office, business office, etc. 

--advising on design of campus buildings 

—interviewing faculty candidates 

— keeping records 

—preparing minutes 

—writing and answering memorandums 

--advising on library purchases 

—escorting prospective students, parents, or special guests 
—recruiting students. 

9. C.3, Committee Participation 

All committee activities related to academic affairs and institu- 
tional governance that have not been included elsewhere are recorded 
in this section, for example: 
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—general department staff meetings 
--faculty senate 
—dcademic standard committee 
--collective bargaining committees. 

The level code for activity categories C.2, Administrative Activities, 
and C.3, Committee Participation, is meant to distinguish between 
activities that deal with a department or subunit of the institution 
and those that deal with the entire institution. Level codes 1 and 
2 should be used for activities concerned with subunits of the institu- 
tion such as departments and colleges, and codes 3 and 4 for those 
activities that deal with the entire institution. The level codes 
are included on the data collection form for the institution's 
benefit and should be changed or eliminated if they are inappropriate. 

Level of Administrative and Committee Activities 



Code Level 

1 Department/unit 

2 Subunit of institution larger than department 

3 Institution-wide 

4 System-wide— if activity concerns several institu- 
tions of a system 
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FIGURE 7 

ACTIVITY CATEGORY D, PUBLIC SERVICE ACTIVITIES 
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10. D, Public Service 

This category is for those activities that are directed prin- 
cipally outside the institution (see Figure 7). The following 
activities would be included: 

—consulting 

—giving professional advice 

—directing or participating in community training grants 
--urban extension 

—giving lectures or seminars for the general public 
—patient care 
—agricultural extension. 

Time spent in extension instruction should be included in 
section A.l of the data collection form. Some institutions 
may wish to change the wording of section A.Ts instructions 
to terminology that is familiar to the faculty. This would 
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help insure the inclusion of all public service teaching 
activities in section A.l. 

The activity categories, more than any other part of the 
survey instrument, need to remain unchanged if an institution 
wishes to exchange any activity information in a manner com- 
patible with NCHEMS' recommendations and procedures. 
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C. Time-Reporting Column 



The time-reporting column (see Figure 8) is used to record the average 
hours per week that a faculty member spends in each listed activity. 

FIGURE 8 

TIME-REPORTING COLUMN AND INITIAL ESTIMATE BLOCK 
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Faculty, when completing the instrument, should list their activities 
in the appropriate activity category and then estimate the time spent 
engaged in that activity. This estimate is recorded in the time- 
reporting column adjacent to each activity. As a help in estimating 
the hours spent in each activity, an initial estimate block is 
included at the top of the form. The faculty member can use this 
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block to make an initial estimate of the average number of hours 
worked each week. This total can then be broken down to record the 
relative amount of time spent in each of the activity categories. 

Although NCHEMS recommends using hours as the unit of measure for 
faculty activity, an institution should be aware that there is 
considerable, controversy as to whether hours are preferable to 
percentages. Previous survey instruments have used both hours and 
percentages of time to indicate the relative amounts of time spent 
in different activities. Unfortunately » there is no conclusive 
evidence that one is better than the other in all situations. For 
example, reporting in hours is considered desirable because hours 
allow faculty to report on the full extent of their workweek. 
Faculty do not work a standard 40-hour week. Many faculty work 
many more than 40 hours, and the variation in time worked above 40 
hours is considerable. These variations have little relationship 
to the kind of activity or the tasks assigned. They reflect the 
life style of the individual faculty member and many faculty members 
wish to indicate the extent of their workweek by recording the total 
hours worked per week. 

Another advantage of reporting in hours is apparent when the activity 
analysis is utilized for budgetary fund acquisition and allocation. 
In order to determine how many faculty positions are needed and what 
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staffing patterns are necessary for different parts of the instruc- 
tional programs, activity data needs to be in a quantifiable form 
that can be related to student enrollments and faculty teaching loads. 
Hours are better suited for this task than are percentages. 

However, hours are not the best in all situations. For example, 
percentages sometimes seem more desirable because hours do not 
directly measure the "quality" or the productivity of the effort. 
Hours do not adequately account for the different yet equally effec- 
tive styles of work. In contracts percentages allow for some 
implicit weighting by the faculty member for effort and quality of 
effort. If the faculty member feels that an activity resulted in 
a particularly high quality product even though the activity con- 
sumed very little time, that activity could be given a percentage 
value that was more commensurate with its value. 

NCHEMS has advocated the use of hours as the reporting unit because 
the concept of effort or quality of effort is very difficult to 
quantitate and is subject to widely different interpretations 
from one faculty member to another. The use of hours is believed 
to give a more uniform unit of measure and additionally it has a 
broader range of application. 
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Outcome Categories 

A difficult problem that appears when the results of an activity 
survey are evaluated involves the relationship between the activities 
of faculty and the intended outcomes of those activities. Knowing 
the activities of faculty does not give the institution information 
about the intended outcome of those activities. For example, faculty 
may report a substantial amount of time devoted to research, but what 
is the nature of that research? Is the research activity intended 
to develop new knowledge for mankind and contribute to the institu- 
tion's national research reputation, or is the activity more student- 
oriented, intended as a training exercise for students? The activity 
could be directed toward either objective or some combination of the 
two. The outcome categories are an attempt to obtain some indication 
about the outcomes that result from faculty activity. The user must 
be aware, however, that the oucomes as indicated on the data collection 
form are the outcomes as perceived by faculty. They are the faculty's 
perception of the results and benefits of their activities. They are 
obviously not an absolute quantitative al location of faculty time to 
institutional outcomes but they do serve as a useful communication 
device. The distribution of faculty activity to outcomes communicates 
how faculty perceive their mission in the institution. 
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The outcomes dititension is completed by indicating the percentage 
distribution of oach activity across the outcome categories. For 
example, a faculty member may teach a lower level course that is 
perceived as being completely for student growth and development. 
In this case the form would be completed as shown in the first line 
of the following example. 
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Faculty members might also teach a graduate-level course that is 
concerned with developing the students' research abilities. In this 
case, they might allocate some of their time to student growth and 
development and some to the development of new knowledge and art 
forms as shown in line two of the example. The following is a 
listing of the outcome categories and their definitions. 
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(k) Student Growth and Development: Results and benefits of 
activities that contribute to enhancing personal, social, 
academic, and/or career aspects of students who are registered 
in the institution. 

(1) Development of New Knowledge and Art Forms: Results and 
benefits of activities that contribute to the development, 
storage, utilization, and/or appreciation of knowledge and 
art in society. 

(m) Community Service and Development: Results and benefits of 

activities that contribute to educational growth in and ijrovide 
short- or long-range utility to the non-academic community. 

(n) Inseparable Combination of (k), (1), and (m): Research and 
benefits of activities that contribute to student growth and 
development, development of new knowledge and art forms, and 
community service and development and cannot be reasonably 
separated. (Please separate if at all possible.) 



This list of outcomes may be modified to incorporate others that are 
more valued by the institution. If the categories are altered, 
NCHEMS cautions the user that comparisons with other surveys that 
have different outcome categories may not lead to valid conclusions. 
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Fiscal Reference Block and Column 

The faculty activity analysis survey instrument is designed to 
collect activity information covering a faculty member's full pro- 
fessional life. The instrument does not attempt to constrain the 
list u ■ possible activities that faculty members might consider. 

In addition, the instrument is structured to be consistent with 
faculty activity patterns and is not necessarily consistent with 
an institution's accounting administrative structure. The fiscal 
reference block and column are included on the data collection 
form to enable an institution to distinguish funded and unfunded 
activities and to link the funded activities to the appropriate 
budgetary accounts. The use of the fiscal reference block and 
column allows an institution to edit for activities that are not 
funded and to determine the range and magnitude of activities that 
are funded from each budgetary account. A more complete discussion 
of the use of the fiscal reference block and column appears in the 
FAA: Interpretation and Uses of Data. 

The fiscal reference block contains seven items of information (see 
Figure 9). The information is used to describe and categorize 
each of the budgetary accounts that contribute to a particular 
faculty member's compensation. A separate and different fiscal 
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reference block should be completed for each faculty member in an 
institution. The fiscal reference block for each faculty member 
will contain a separate line for every budgetary account that con- 
tributes to the faculty member's compensation during the time period 
covered by the survey. Each of the seven items of information is 
listed and described below. 

FIGURE 9 
FISCAL REFERENCE BLOCK 



FISCAL REFERENCK BLOCK 



ACCOUNT 
TITLE 



DEPARTMENT/ 
UNIT 



PCS 
CODE 



ACCOUNT 
NUMBER 



SALARY 
DOLLARS 



Reference Column : The reference column is used to assign a code 
for each budgetary account that contributes to a faculty member's 
compensation. This code is used to link each of the budgetary 
accounts with the faculty member's activities (see page 40). The 
codes that are used should be consistent for all faculty within 
an institution and should reflect the type of account categories 
that are useful to the institution. A simple example of a possible 
coding system follows: 
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Code 



Account Category 



Instruction and Departmental Research 



B-G 



Separately Budgeted Research— each separate research 
project gets a separate code; if a faculty member has 
two research assignments the first would be coded "B" 
and the second "C" 



H 



Extension and Public Service 



A 



General Administration and Institutional Support 



The coding displayed above is only an example; an institution should 
devise its own list appropriate for its own purposes. In considering 
the account category structure to use, an institution should be aware 
that a standard function classification structure is presently being 
jointly developed by NCHEMS, National Association of College and 
University Business Officers (NACUBO), and the American Institute of 
Certified Public Accountants (AICPA). 

Full -Time Equivalency : The FTE column lists the full-time equivalency 
assigned to each budgetary account during the period covered by the 
survey. 

Account Title : The account title column contains the institution's 
label or name of the account category such as instruction, research, 
administration, etc. 
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Department/ Unit : The department/unit column is for the designa- 
tion of the department or unit in which the faculty member carries 
out the work. Either a code or alphabetic description may be used. 

Program Classification Structure Code : This column >"ecords the 
Program Classification Structure code for each of the budgetary 
accounts used to compensate faculty. A description of this 
structure can be found in NCHEMS' Technical Report 27, Program 
Classification Structure (Gulko, 1972). This information is 
included because it facilitates the assignment of PCS codes to 
each activity listed by faculty (see the FAA: Interpretation of 
Uses and Data for assignment of PCS codes). 

Account Number : The account number column contains the number of 
each budgetary account that is used to support the faculty member. 

Salary Dollars : The salary dollars column records the salary 
compensation received by the faculty member from each of the 
budgetary accounts. 

The fiscal reference block is of little value unless it is used in 
conjunction with the fiscal reference column. The fiscal reference 
column is the link between the activities as reported by faculty and 
the budgetary information as listed in the fiscal reference block. 
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The fiscal reference column appears on the far-right-hand side of 
the form (see Figure 10). It is completed using the budgetary 
account codes that appear in the reference column of the fiscal 
reference block. Each activity listed by a faculty member receives 
a code that indicates the budgetary account supporting that 
particular activity. If an activity is considered to be uncom- 
pensated it should be coded with an N or S, described as follows; 

Code Activity 

N Not supportive of the mission of the institution and 

therefore NOT compensated 

S Supportive of the mission of the institution but not 

compensated. 

Please note that S and N codes should not be used for budgetary account 
categories as listed on page 40. An example of a survey instrument 
with a complete fiscal reference block and column appears in Figure 10. 
Multiple codes may be entered if an activity is considered to be com- 
pensated for multiple budgetary accounts. 

The previous discussion describes how the fiscal reference block and 
column are completed. An equally important consideration is how the 
survey instrument with the fiscal reference block and column should 
be administered. An institution needs to decide: (1) the order 
of completing the survey instrument, the fiscal reference block and 
the fiscal reference column; and (2) what level of administrator 
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FIGURE 10 

USE OF THE FISCAL REFERENCE BLOCK AND COLUMN 
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FIGURE 10 (Continued) 
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should oversee the completion of the fiscal reference block and 
col umn . 

These questions should be given considerable thought before an 
activity survey is initiated. 

During the pilot test these considerations were dealt with as follows: 

The fiscal reference block was printed on separate labels. 
The faculty completed all other parts of the survey instrument 
and then the label was attached to the upper portion of the 
data collection form. Some institutions completed these 
labels prior to and others after attaching them to the form. 

After the survey instrument was completed by the faculty and 
the fiscal reference block was completed and attached, the 
department chairman or other unit administrator completed the 
fiscal reference column. 

The advantages of this approach are: 

1. The faculty do not see the fiscal reference block as they are 

completing the instrument. This avoids the necessity of explain- 
ing the mechanics of how the budgetary data will be linked to the 
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activity data. This does not mean that the institution should 
conceal the fact that activities will be linked to budget data; 
the institution should describe how the FAA data will be used. 
However, the absence of the reference block will free those 
persons administering the instrument from explaining each of the 
fiscal reference block categories and the mechanics of how the 
collected data will be linked together. 

2. The faculty do not have a completed fiscal reference block avail- 
able when they complete the survey instrument. The absence of 
this information will decrease the chances of the faculty 
matching their activities with their budgetary assignments 

and will keeo faculty estimates of their time as unbiased as 
possible. 

3. The department or unit chairmen are probably better able to 
review their faculty's activities than any other individual in 
the institution. Having the department chairman complete the 
fiscal reference column allows for a department-by-department 
review of the faculty's activities by an individual who is 
familiar with faculty members and their work. 

This approach worked very smoothly during the pilot test. The only 
drawback was that little discussion occurred between department or 
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unit chairmen and there was a wide range in what kinds of activities 
were considered compensated. This range may be legitimate but it is 
probably in the institution's interest to set forth guidelines or to 
conduct some discussions with the department or unit chairmen to 
insure that there is good reason for the approach taken by each chair- 
man. During the pilot test one department chairman considered only 
direct teaching activities to be compensated, while another felt 
that golf was very much a part of the faculty member's job. These 
differences, though they may be legitimate, should be discussed to 
insure that the data analysis is done on a consistent basis from one 
department to another. 

The fiscal reference block and column are not required for a faculty 
activity survey, and elimination is at the institution's discretion. 
In evaluating whether to retain this feature, the institution should 
consider the importance of the three functions the fiscal reference 
block and column serve: (1) they allow the institution to segregate 
funded and unfunded activities, (2) they aid the institution in 
evaluating what activities are paid for by each budgetary account, 
and (3) they aid the institution in assigning Program Classification 
Structure (PCS) codes to faculty activities. 
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F. Discussion of the Additional Information Block 



The additional information block records information about the faculty 
that might be useful in characterizing a faculty's activities or that 
might be useful to a department or unit chairman (see Figure 11). 
The following is a list and definition of the recommended information: 



Institution: designation of the institution surveyed 

Term: designation of the term covered by the survey 

Tenure: designation as to tenure status of the faculty member 

Years at the institution: designation as to the number of years 
the faculty member has been at the institution 

Years in rank: designation as to the number of years since the 
faculty member was last promoted 

Principal department: designation of the faculty member's 
principal department 

Administrative rank: designation indicating if the faculty 
member also holds administrative rank as department chairman 
or dean 

Faculty rank: the rank or physical designation of the faculty 
member 

Length of appointment: the number of months specified in the 
faculty member's appointment. 
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SECTION III 

CONCERNS IN PLANNING A FACULTY ACTIVITY SURVEY 



The previous section presented a description of the NCHEMS Faculty 
Activity Analysis survey instrument. This instrument is a versatile 
tool and may be utilized in a wide variety of ways. This section 
describes the alternative approaches that an institution might utilize 
in conducting a faculty activity survey. The particular approach taken 
is an institutional concern and is dependent upon the intended use of 
the survey outcomes. 

There is no one best way to conduct a faculty activity survey. For 
this reason, alternative procedures are presented. The issues surround- 
ing each alternative are identified and discussed. Although multiple 
alternative approaches are explored, specific recommendations are made. 
These recommendations are appropriate for most institutions and will 
satisfy the data requirements for the types of analyses that will be 
described in the FAA: Interpretation and Uses of Data . NCHEMS suggests 
that an institution initiating a faculty activity survey follow these 
recommended procedures on the first administration of the survey. If 
these recommended procedures later prove to be somewhat unsatisfactory, 
the experience gained in the initial administration of the instrument 
will help the institution decide upon the appropriate alternative 
procedures. 
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Survey Time Period 



A survey time period is the length of time the faculty activity is 
to be studied in the survey. It could be a week, a term, an x;-^' 
academic year, or a fiscal year. The appropriate survey time period 
is dependent upon the intended uses of the survey outcomes. For 
example, if the survey is to be used to support costing, the insti- 
tution might want to know the faculty time distribution for a fiscal 
year. If the study is to serve as an information base for planning 
future staffing levels based upon the time required to teach different 
types of courses at different course levels, then the survey time 
period might be an academic term. If the survey is to be used to 
observe the fluctuations in faculty activity patterns from one week 
to another over the course of an academic term, the institution 
might conduct multiple surveys each covering one week of the academic 
term. 

Each of these purposes is equally legitimate, but each requires a 
somewhat different survey time period. NCHEMS' survey instrument 
may be used to conduct a survey covering a time period of one day 
to several years. However, any single administration of NCHEMS' 
FAA survey instrument should not be used for a survey time period 
greater than one academic term. 
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The disadvantages of the first approach are the following: (1) 
faculty are inconvenienced by completing the survey each term; 
(2) an activity survey involves a significant amount of time and 
effort and some surveys consume more time; and (3) an additional 
concern is that, as more surveys are conducted, less analysis is 
usually performed and the survey effort becomes one of mechanics 
rather than analysis. 

In using the second approach, it becomes important to identify the 
level of aggregation desired and then evaluate the stability of 
faculty activity at that level. The evaluation can be performed 
by either qualitative estimation or by a quantitative approach 
utilizing the first method. 

The third approach is similar to the first except that a sample 
of the faculty is used from each term (see Section III B). The 
advantage of sampling is that potentially fewer faculty need to be 
surveyed in order to obtain acceptable estimates of average faculty 
activity profiles. When fewer faculty are surveyed, the costs 
associated with administering the instrument are reduced. The 
disadvantage of the sampling approach is that for estimates of 
activity profiles at low levels of aggregation (that is, disaggrega- 
tion by department and rank), the sample size required often 
approaches the size of the total faculty population. 
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For an institution's first administration of a faculty activity 
survey, NCHEMS recommends a survey time period equal to one academic 
term. Further, NCHEMS recommends that only one term in the academic 
year be surveyed. It is expected that some institutions will 
eventually wish to expand their survey to encompass an academic or 
fiscal year, but this is not a recommended procedure for the first 
administration of the survey. This recommendation — survey time 
equal to academic term — provides the institution with sufficient 
information to allow it to thoroughly study its faculty's activities. 
Conducting additional surveys covering other academic terms or 
sampling faculty from each academic term greatly increases the 
effort required and prolongs the survey without providing much 
additional information. Adopting NCHEMS' recommended approach 
provides an institution with a low-cost opportunity to evaluate 
how it can best utilize faculty activity information. It further 
provides the institution with a faculty activity analysis experience 
that will be helpful if it later wishes to expand the scope of future 
surveys. 
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B. Alternative Sampling Procedures 

There are two ways to study the characteristics of a total popula- 
tion such as the faculty of an institution. One way is to study the 
entire population, the other is to study a portion of that population 
and assume that these characteristics are representative of the total 
population. It is possible to design statistically a procedure for 
the selection of a sample or subset of a population that will be 
representative of the total populacion to a measurable degree. This 
section addresses, the question of when it is appropriate and advisable 
to sample when conducting a faculty activity analysis and, further, 
it describes alternative sampling procedures which may be used in 
conducting a faculty activity analysis. Please refer to any one 
of a number of excellent references to determine the specifics 
of sampling methodology. (See, for example, the following references: 
Hansen, Hurwitz, and Madow [1953], Kirk [1958], Kish [1955].) 

In evaluating whether to sample faculty, the critical question 
is, "What proportion of the faculty must be sampled in order to 
obtain a confident estimate of an average activity profile of a 
faculty member?" If the required sample size is 20-25% of the 
total population, there is good reason to use a sampling technique. 
In this case fewer faculty are troubled with having to complete a 
survey instrument, and fewer forms are collected that must be pro- 



ERLC 



cessed and analyzed, resulting in an overall lower expenditure 
of effort. However, if the samole size required is 75-80% of tlie 
total population, the time saved in administration is outweighed 
by the time required to design the sampling plan. 

One of the important determinates of the proportion of the total 
faculty population to be sampled is the size of that population. 
For example, if the institution desires an estimate of the average 
activity profile for the five faculty members of the classics 
department, it will need to survey all five faculty members. How- 
ever, if the institution needs only an estimate of the average 
activity profile for its 500 faculty members, a 25% sample is likely 
to be adequate. The institution that is considering the use of 
sampling must determine the population of the groupings of faculty 
that it desires to study. If these groupings are department ranks 
or ranks within departments, then the faculty population in each of 
these categories must be determined. If most of these populations 
are small (1 to 40), then sampling faculty is probably not a useful 
approach. If most of the populations are large, the institution 
might wish to consider sampling. 

An alternative sampling approach ir a faculty activity survey 
involves dividing the survey time period into discrete sub-sections 
and randomly selecting a portion of the faculty to complete the survey 
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instrument for each of the sub-sections. For example, a sixteen- 
week semester might be divided into. four fourweek time periods. 
One group of faculty would complete the instrument for the first 
t*^me period; a second group of faculty would complete the instru- 
ment for the second time period, and so on. Estimates for the average 
faculty activity profile could then be developed for each of the sub- 
time periods and for the total survey time period. The advantages 
of this approach are: (1) faculty do not ne'dd to remember tivclr 
activities over a long period of time and presumably this results in 
a better estimate of their activities, and (2) an institution can 
study fluctuations in faculty activity patterns within an academic 
term. However, the disadvantages of this alternative sampling 
approach are great. Each sub-time period becomes a separate statistical 
experiment, and the considerations involved in any statistical design 
must be made for each sub-time period. This greatly increases the 
complexity of the survey. An additional level of complexity is 
introduced when estimating the overall activity profiles of the 
total time period from the individual activity profiles for each 
sub-time period. In addition, in the use of faculty activity analysis, 
the problems of statistical design center on the level of disaggregation 
of faculty in the study. This problem does not diminish by studying 
sub-time periods; in fact, it is complicated by the additional time 
dimension. 
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Outlining all the considerations in this approach is beyond the 
scope of this manual; for more information, please refer to 
standard statistical texts. 

NCHEMS recommends that an institution use a census to collect 
faculty activity information. NCHEMS believes that most uses 
of faculty activity information will require data by department or 
other relatively small grouping of faculty. In this case, the 
sample size approaches the size of the total population and no 
benefit from sampling is realized. However^ if an institution 
needs only faculty activity information about large groupings of 
its f.aculty and has no need for more disaggregate information, 
then Sc'mpling may be appropriate. 
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When to Administer the Survey 

As part of the pilot test of the NCHEMS survey instrument and 
procedures, the University of Michigan tested whether there was 
a significant difference in how faculty report their activities 
if the instrument were administered at the beginning or in the 
middle of the semester. In both cases the time period covered by 
the survey was one academic term. This test investigated whether 
faculty perception of what they would do during the semester 
differed significantly from their perception of their activities 
once the semester was half over. 

This question of when to administer the instrument was answered 
quite clearly. Tables 1 and 2 concisely demonstrate that no 
differences existed between the administration of the survey 
instrument in the early part of the term versus the middle of 
the term when either NCHEMS* or the University of Michigan's 
survey instrument was used. 

The possibility exists that asking faculty members at the end of 
a term to recall their activities might produce some genuine differ 
ences. These would be differences of retrospection versu ; pro- 
spective estimation. Nevertheless, the current evidence is that 
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the time during the term when the estimate is required is irrelevant. 
This conclusion is further substantiated in studies by Lorents,* 



*Lorents, Alden C, , Project PRIME Report #6, Faculty Activity and 
Planning Models In Higher Education , June 1971, (Project PRIME Resource 
Coordinated by the Minnesota Higher Education Coordinating Commission,) 
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TABLE 1 



TESTS FOR SIGNIFICANT DIFFERENCES IN ACTIVITY SCORES 
CAUSED BY TIME OF REPORTING WHEN NCHEMS ' 
FACULTY ACTIVITY AND OUTCOME SURVEY WAS USED 



Acti vi ty Category* 


Mean % from 
Early Reporting 


Mean % from 
Middle Reporting 


T Value 


Credit Instruction 


44.95 


44.29 


0. 15 


Non-Credit Instruction 


15.29 


15.46 


-0.05 


Research and Creative 
Activity 


20.78 


20. 14 


0.13 


Service Activity 


3.61 


5.27 


1.54 


Administrative Activity 


7.42 


6.23 


0.50 


Professional Development 


7.95 


8.61 


-0.47 



Degrees of Freedom = 83 



*A11 activity categories are taken from the University of Michigan's 
Academic Activities Personnel Report. Please see Section IV B. 
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TABLE 2 



TESTS FOR SIGNIFICANT DIFFERENCES IN ACTIVITY SCORES 
CAUSLD BY TIME OF REPORTING WHEN UNIVERSITY OF MICHIGAN'S 
ACADEMIC PERSONNEL ACTIVITIES REPORT WAS USED 



Activity Category* 


Mean % from 
Early Reporting 


Mean % from 
Mi ddle Reporting 


T Value 


Credit Instruction 


54.14 


50.95 


0.60 


Non- Credit Instruction 


12.23 


13.19 


-0.41 


Research and Creative 
Acti vity 


18.91 


17.64 


0.27 


Service Activity 


4.00 


3.36 


0.60 


Administrative Activity 


4.93 


8.60 


-1.36 


Professional Development 


5.79 


6.26 


-0.32 



Degrees of Freedom = 84 



*An activity categories are taken from the University of Michigan's 
Academic Activities Personnel Report. Please see Section IV B. 
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NCHEMS recommends that the institution choose a time during the 
term that will be most convenient for faculty. The tabulations 
of a faculty questionnaire used in conjunction with the pilot 
test and other faculty reactions indicate that faculty prefer 
being surveyed toward the end of the term but not during final 
exam periods (see Appendix B) . 
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D. How Often to Administer the Instrument 



The answer to this question is a function of two factors: (1) 
the nature of change in faculty activity in an institution, and 
(2) the ultimate use of the survey outcomes. In responding to 
demands of relevance and renewal in higher education, institutions 
may make policy which may be reflected by changes in faculty 
activity profiles. For this reason,, measurements of faculty 
activity must be taken often enough to reflect current institu- 
tional posture and policy. The ultimata use of the outcomes of 
the survey also affects the frequency of the study. 

For some purposes this may require a survey from each academic term 
in the year and for other purposes a survey every three or four 
years is probably adequate. If the information from a faculty 
activity survey is part of an institution's operational data system 
and is used as the primary source of information on faculty teach- 
ing loads, the time period covered by the survey (Section III A) 
should probably be one academic term and the survey should be con- 
ducted each tey^m. However, most institutions obtain this teaching 
load information from other sources and would use an activity 
survey to obtain a general picture of how faculty are allocating 
their time to institutional programs. In this case the institution 
needs to evaluate the stability of the activity data over time. 
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NCHEMS recommends that the survey initially be conducted once a year. 
If the institution finds that it needs FAA information for all terms, 
it can later expand tlie survey to include each survey and test for 
the stability of the desired information. If the institution finds 
that the results are stable from one year to the next, it might 
consider conducting the survey less frequently than once per year. 
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Methods of Administering the Survey 

During the pilot test the Faculty Activity Analysis Task Force 
wished to investigate what effect different methods of administering 
the survey instrument would have on the survey results. Three 
different methods were tried: 

1. Self-Administered Survey: The instrument was mailed to 
individual faculty members who completed the instrument by 
themselves, using only the instructions provided in the survey 
instrument. 

2. Group-Administered Survey: Groups of faculty were brought 
together for the purpose of completing the survey. The pur- 
pose of the survey was explained, completion instructions 
were described, and questions regarding the instrument were 
answered. 

3. Interviews: Individual faculty interviews were conducted. 
The interviewers explained the purpose of the survey and then 
led the faculty member through the form. 

Appalachian State University (Boone, North Carolina) tested for 
differences resulting from the ^iiethod of administering the instru- 
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ment. Its entire faculty was randomly divided into two groups. 
One group self-administered the instrument and the other group 
was randomly divided between the group-administered method 
and the interview method. This division resulted in the follow- 
ing sample sizes: 

Self- Group- 
Administered Administered Interview 

185 98 91 

Members of the self-administered group received the instrument 
in the campus mail accompanied by a cover letter explaining the 
purpose of the survey. Those faculty who had the instrument 
admin1sterf=^d in groups participated in one of ten group meetings 
where from three to fifteen faculty members were present 
(scheduling constraints made it impossible to equalize group 
sizes). Eight members of the institutional research office 
conducted the individual interviews. These same interviewers 
conducted the ten group sessions. The interviewers were 
familiar with interviewing strategy. They were briefed by the 
Director of Institutional Research concerning how they were to 
conduct the interviews and how they should respond to a variety 
of questions. 
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Only a few of the many tests conducted indicated a statistically 
significant difference resulting from the method of administer- 
ing the survey instrument. Table 3 lists the categories tested, 
and Table 4 lists those tests where a statistically significant 
difference was found across the three methods of administering 
the instrument. 

The only activity categories where a significant time difference 
was recorded were C.2 and C.3 (Administrative Duties and Committee 
Participation). In these sections no significant difference 
was found in the hours recorded; the only significant difference 
was in the relative amount expressed as a percent of the total 
compensated hours. All the activities that were considered to 
be non-compensated by the institution and therefore coded with 
an N or 5 (see Section II E) were dropped* 

No conclusive explanation exists as to why categories C.2 and 
C.3 were significantly different. The most probable answer 
is that the individuals conducting the interview and group 
sessions influenced the faculty to some degree. It is possible 
that in these categories they inadvertently encouraged addition.^ 
activities to be listed and receptively more time to be recorded 
for each activity. Table 5 shov.s that move lines (activities) 
were included in C.2 and C.3 where the group and interview 
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administration techniques were used; likewise, the ratio 
of the average hours to average number of lines indicated the 
hours recorded per activity or line were greatest for the inter- 
view group in C.2 and C.3. 

The out'^ome distribution of only one section (A. 3, Academic 
Program Advising) was found to be significantly different 
among the methods of administration. In this section a great 
deal more emphasis was placed on student growth and development 
when the group and interview techniques were uied. The relative 
importance of the differences is slight since the overall per- 
centage of time reported in A. 3 was only 2.5. 

The final significant differences relate to the use of level 
codes in Section A. 4 (Course and Curriculum Research and Develop- 
ment) and Sections C.2 and C.3. The individuals who conducted 
the interview and group sessions apparently encouraged the 
faculty to use the level codes. 

NCKEMS recommends using either the self -administered or group- 
administered technique » The interview technique provides little 
benefit over the group technique and is considerably more expensive. 
An institution should seriously consider using the group technique 
the first few times the survey is conducted* After faculty become 
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more familiar with the instrument the group sessions become less 
important^ 
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TABLE 3 

ITEMS TESTED FOR DIFFERENCES AMONG 
METHODS OF ADMINISTERING THE INSTRUMENT 



Number Items Tested 



1 Total hours reported on entire instruinent 

2 Hours reported in each section (A.l-D^ of instrument 

3 Hours reported in each section (A.l-D) of instrument (%) 

4 Compensated activities reported in each section (A.l-D) 

of instrument (no.) 

5 Compensated activities reported on entire instrument (no.) 

6 Time devoted to each outcome category (overall %) 

7 Time in each section (A.2-D) of instrument devoted to each. 

category (%) 

8 Activities not distributed to outcomes (%) 

9 Activities in Sections A.2> A. 3, and A. 4 with no level 

code {%) 

10 Activities in Sections C.l and C.2 with no level code (%) 
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TABLE 5 



DIFFERENCE RECORDED IN 
ACTIVITY CATEGORIES C.2 and C.3 (ADMINISTRATIVE DUTIES 
AND COMMITTEE PARTICIPATION) BY METHOD OF ADMINISTRATION 



Sections C.2 and C.3 


Self- 
Administered 

(%) 


Group 
Admi nistered 
(%) 


Indi vi dually 
Administered 
(%) 


Averr.ge Percent of 
Time Reported 


7.0 


7.2 


11.9 


Avereiye Hours 
Reported 


4.9 


4.6 


7.8 


Average Number of 
Lines Reported 


1.6 


1.9 


2.1 


Ratio of Average Hours 
to Average Number of Lines 


3.1, 


2.4 


3.7 
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SECTION IV 

MAJOR CONCERNS IN CONDUCTING A FACULTY ACTIVITY SURVEY 



Earlier in this manual, we describe the survey instrument and provide 
recommended procedurer^ for conducting and administering a faculty 
activity survey. This section deals with some of the broader concerns 
in undertaking a faculty activity survey. Will the results of the 
survey be accurate and consistent for U5e in planning and management 
in the institution? To what extent are th*:* results of a faculty 
activity survey comparable among institutions? What are the major 
factors influencing faculty acceptance of the activity survey? What 
are the components of costs of administering the faculty activity 
survey, and what is the nature ^f these costs? 

This section identifies major concerns of institutions and planning 
boa'^ds in undertaking a faculty activity ourvey in an institution. 
In addition, it provides document^ition on multiple field tests of 
f^^culty activity analyses using NCHEMS' survey instrument and pro- 
cedures, and provides guidelines for using the instrument and pro- 
cedures relative to the major concerns. 
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The Accuracy and Consistency of Faculty Activity Surveys 

An institution that is considering a faculty activity survey has 
concerns about the answers to the following questions regarding 
the accuracy and the consistency of faculty activity data: 

1. Are the collected data accurate— that iSj do the data accurately 
reflect the actual distribution of faculty to the activities? 

2. Are the collected data consistent--that is, are the results 

the same when the data are collected under similar circumstances 
with a similar instrument? 

3. What mechanism of collecting activity data will deliver the 
required amount of accuracy and consistency with the least 
cost and the least faculty resistance? 

The principal problem in addressing these questions is that there 
is no method of collecting data that results in indisputably accurate 
results: any method is potentially subject to some bias. Although 
some methods seem better than others, none are perfect. For 
example, most analysts would agree that the results of work -sampling 
studies probably would be more accurate and more consistent than 
other methods of conducting a faculty activity analysis. This tech- 
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nique makes use of impartial observers who observe faculty activity 
at randomly selected time periods according to a sampling plan. All 
of these individual observations are then used to estimate the average 
distribution of faculty time. This method would seem to be extremely 
accurate. However, conducting a work-sampling stucly of faculty witn- 
out upsetting the activities that the study is attempting to measure 
is extremely difficult. Faculty have very individual work styles: 
some faculty work at night, some v/ork at home, and others work in 
locations far removed from the institution. Because of the vari .ty 
of work styles and locations, it is difficult to observe faculty 
at randomly selected time points without disturbing and potentially 
changing the faculty member's routine. Therefore, even the faculty 
activity analysis method that potentially offers the most accurate 
and consistent results is subject to some limitations. The question 
an institution needs to face is, how accurate and how consistent its 
activity data need to be in order to be useful. 

Most institutions are not interested in knowing to a high level of 
accuracy what each faculty member is doing. The institution 
usually needs only a general indication that it can use for planning, 
for budgeting, or for -program review. The institution needs tr know 
the relative amounts of time devoted to research or instruction, or 
it may want a general indication of the tine required to teach differ- 
ent types of courses in different disciplines and need this information 
in the form of averages for different groups of faculty. 
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The more accurate techniques of collecting activity data certainly 
meet these requirements. They do give the institution a profile 
of faculty activity. The problem with the more accurate techniques 
is that they are very expensive to implement. A work-sampling study 
involves a tremendous number of man hours in planning, conducting, 
and analyzing the results of the study. For this reason many insti- 
tutions hive used a quoi;tionnai re-styled survey inst^^ument that is 
completed by faculty to record their acM-^Uies for the entire 
survey time perked. is type of activity study is far less 
expensive to conduct, but it is subject to mort^ jrror. Several 
.v^udies have been conducted that compare the results of a question- 
naire-styled survey with a more accurate survey technique. The 
difference between these data collection methods is often relatively 
small. A study by Lorents (1971) presents a good example of the 
magnitude of the differences that might be expected. 

The Lorents study involved three randomly selected groups of faculty. 
Two of the groups were asked to use a questionnaire-style instrument, 
similar to NCHEMS' instrument, to estimate the time they would spend 
engaged in different activities throughout an academic term. One of 
these groups made its estimate at the beginning of the term and the 
other at the end of the term. Tne third faculty group participated ' 
in a random self-sampling experiment <iuring the term. The random 
self-sampling experiment made use of a random "beep" device. This 
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dfevice generated an audible signal at random points in time. The 
faculty member who participated in this experiment carried this 
device and recorded his activity whenever the device emitted a 
signal. The results of the random self-sampling experiment were 
compiled and compared with the pre- and post-term estimation. The 
results of this study are displayed in Figure 12. 

Each of the activity categories was tested to determine if the 
reported hours differed significantly, depending on the data collec- 
tion method. The randcm self-sampling results were used as the 
standard and were compared id both the pre-term and post-term 
estimates. The differences in the datL collection methods were 
found to be statistically significant for two activity categories. 

When the random self-sampling data were compared with the pre-term 
estimates, the differences in the average hour per week for the 
institutional service and professional development categories were 
found to be statistically significant. When the random self-sampling 
data were compared /\/ith post-term estimates, the differences in the 
average houif pev week far the preparation and other instruction 
activity categories were found to be statistically significant. 



77 



FIGURP \Z 



COMPARISON OF WORK ESTIMATES MADE 
AT THE BEGINNING OF THE TERM, AT THE 
END OF THE TERM, AND A RANDOM SELF-SAMPLING EXPERIMENT 
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If the random self-sampling data were used as a staiidard and assumed 
to be accurate, then pre- and post-estimates were accurate in nine 
out of eleven categories. The importance of this stud> is not that 
two categories were significantly different, but that only two were 
significantly different between a more costly random se'lf-sampling 
approach to activity analysis and a relatively inexpensive estimate 
approach. This study further indicates that faculty are capable of 
making reasonably good estimates of their time at either the begin- 
ning or the end of the term (see page 58 for a discussion of when to 
conduct a survey) . 

in developing an activity analysis survey i,nstrument, NCHEMS started 
with the assumption that activity data could be collected with the 
necessaiy amount of acccrracy and consistency using a questionnaire- 
styled survey instrument. The reliability of thts a^^sumption seems 
to depend primarily on the climate in which tfie sun/ey is conducted. 
It is/iiTiportant to realize th<it the instrument is comply. ad uy 
faculty and cannot be used 'as a control mechanism. If faculty 
perceive that some type of punitive action will result from the 
activity dist>ributions they report, they are likely to alter their 
r -^ported activities to reflect the desired distributions. An insti- 
tution that conducts a faculty activity survey must be very careful 
to avoid biasing the results in this way. 
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During the pilot test of the FAA survey instrument, the faculty 
profiles from different institutions were used to check the face 
validity, that is, to see if the distribution of faculty activity 
reflected what might be expected. Figure 13 displays the percentage 
distribution of faculty time to the ten activity categories. These 
distributions show what migfi: be expected. Those institutions that 
are perceived to be more hea^'ily involved in research have larger 
research pWcentages; likewise, those institutions that purport 
to be heavily committed to undergraduate teaching have larger per- 
centages of time in scheduled teaching. Activities such as committee 
participation, course and curriculum research and development, and 
unscheduled teaching and academic program advising remain relatively 
consistent across institutions and are not significantly different 
at the 95% confidence level. These are the kinds of results that 
might be expected and therefore the data collected by the survey 
instrument do have face validity. These results do not prove that 
the NCHEMS' instrument collects accurate or consistent data, but 
that the results are substantiatinri evidence. It is certain that 
if these distributions of time indicated a higher level of research 
at the College of Wooster than at the University of Michigan, the 
accuracy of NCHEMS' survey instrument would be in question. 

The question of the consistency of the activity data collected with 
the NCHEMS survey instru'^ent was investigated during the FAA pilot 
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test at Ar^palc n State University, Boone, North Carolina, Three 
randomly selected groups of faculty were asked to complete the 
instrument. One group completed the instrument by themselves, 
another group completed the instrument with an interviewer, and the 
third group completed the instrument in a group meeting. Compari- 
sons were made of the results obtained through these three methods 
of administering the instrument. No statistically significant 
differences were found in the activity distributions among the 
three groups at the 99% confidence level, and only one was differ- 
ent at the 95% level (a description of this test and a display 
of the results appears on pages 65 through 72). 

This test does not prove that NCHEMS' instrument will record re- 
sponses of faculty that are always consistent, but it does 
indicate that the collected data are independent of the method 
of administration and will show similar distributions of activity 
for faculty that are in the same environment. 

The test conducted to determine when in the term to administer 
the instrument (pages 58 through 62) further supports the assertion 
that the NCHEMS instrument will consistently record faculty activities, 
in this test, no difference was found in the distribution of faculty 
activities when the instrument was completed at the beginning or in 
the middlvi of the academic term. 
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None of these tests proves that the wCHEMS instrument will accurately 
and consistently record the activities of faculty. Each test is only 
an additional piece of substantial evidence that NCHEMS' instrument, 
when used under favorable circumstances, will yield accurate and 
consistent results. Only after numerous addit'^onal activity surveys 
are conducted can a more precise statement be made concerning the 
accuracy and consistency of NCHEMS' FAA -urvey instrument. 
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Consequences of Changing a Faculty Activity Survey Instrument 

The University of Michigan has an activity survey entitled "Academic 
Personnel Activities Report" conducted each fall. As part of NCHEMS' 
pilot test, a comparison was made between how faculty in selected 
units distributed their time to activities using NCHEMS' instrument 
and the University of Michigan's instrument. Thf: three selected 
units were the Department of Electrical and Computing Engineering, 
tlie Department of English Language and Literature, and the School 
of Social Work. 

Since Michigan faculty have experience in completing activity surveys, 
those who were to complete the NCHEMS form simply received a letter 
explaining the pilot test and asking them to complete the Faculty 
Activity and Outcome Survey rather than the usual Academic Personnel 
Activities Report. 

Before any statistical analyses could be carried out, the data from 
the Faculty Activity and Outcome Surveys and from the Academic 
Personnel Activities Reports had to be converted to a common format. 
A set of procedures and a set of decision rules were developed to 
convert the activity hours reported on NCHEMS' Faculty Activity and 
Outcome Survey into the categories and activities utilized by 
Michigan's Academic Personnel Activities Report (necessary because 
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the NCHEMS questionnaire utilizes a larger number of activity 
categories than the Michigan instrument). 

Once the conversion was accomplished, the hours per activity fiiures 
were converted to a percentage distribution across the six major 
categories of Michigan's Academic Personnel Activities Report. This 
was necessary because Michigan faculty are given the option in the 
Michigan survey of reporting their activities in terms of hours or 
percentages. Since percentages cannot be converted to hours, the 
hours were converted to percentages. All social work sample members 
and most of the other sample members who reported using the Michigan 
form reported in percentages. These percentage distributions served 
as activity scores and were analyzed to determine whether significant 
differences had occurred as a result of the instrument used for 
reporting. 

The six activity categories tested were: credit instruction, non- 
credit instruction, research and creative activity, service activity, 
administrative activity, and professional development. These are 
the categories that appear on the University of Michigan's Academic 
Personnel Activities Report. To answer the question of whether the 
particular questionnaire used caused significant differences in 
the way individuals reported their activities, the data set was 
separated into tv/o groups according to whether the respondents 
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used the NCHEMS or the Michigan form. Table 6 shows the results of 
the tests. Respondents using the NCHEMS survey instrument reported 
significantly less time spent in crv?dit instructional activities 
and significantly more time spent in professional development. There 
were only small, insignificant differences in the non-credit instruc- 
tion, research, service, and administrative activity areas. 

The major finding? of this pilot study are the significant differences 
which appear in Table 6 in the credit instruction and professional 
development categories. Since credit instruction accounts for such 
a great portion of faculty activity, a significant difference between 
the two reporting forms in this category would have to be given major 
consideration in any evaluation of either instrument. 

Tests of significance were also performed on each of the participating 
departments. Significant differences did not appear until the data 
were aggregated to the highest level. However, even though the dif- 
ferences were not significant at the department level, the mean 
percentage for credit instruction is higher for the Michigan form 
than for the NCHEMS instrument. A possible explanation for this 
difference is the unit of measurement used: the University of 
Michigan Academic Personnfil Activities Report allows faculty to 
report in either hours or percentages. Several analyses of the 
data give evidence that individuals reporting in percentages tend 
to report a larger percentage of their time in credit instruction 
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than those reporting in hours. Most of the respondents using the 
University of Michigan instrument reported in percentages, as 
opposed to those using the NCHEMS instrument who reported in hours. 
For a further discussion of the unit of measurenient question, see 
Section II C, 



TABLE 6 

TESTS FOR SIGNIFICANT DIFFERENCES IN ACTIVITY SCORES CAUSED 
BY USE OF A PARTICULAR SURVEY INSTRUMENT 



Activity Category 


Mean % from 
NCHEMS Form 


Mean % from 
Michigan Form 


t Value 


Credit Instruction 


44.61 


52.58 


-2.30 sig. d< 0.05 


Non-Credit Instruction 


15.38 


12, 70 


1.40 


Research and Creative 
Acti vi ty 


20.45 


18,29 


0,64 


Servi ce Acti vi ty 


4.47 


3.69 


1.01 


Administrative Activity 


6,80 


6.72 


0.04 


Professional Development 


8.29 


6,02 


2.28 sig.^^^ < 0,05 



Degrees of Freedom = 169 

The other significant difference from Table 6 occurred in the category 
of professional development. Individuals using the NCHEMS instrument 



87 



reported a significantly greater percentage of their time in this 
category than did those who used the Michigan questionnaire. This 
difference also existed in the School of Social Work and the Depart- 
ment of Electrical and Computer Engineering, but not in the Depart- 
ment of English Language and Literature, Although the percentage 
scores are not as great as in the credit instruction category, at 
least the differences apparent at the aggregate level are represented 
at the unit level. The reason for this difference may be defini- 
tional. Both professional development on the Academic Personnel 
Activities Report and General Scholarship and Professional Develop- 
ment on the Faculty Activity and Outcome Survey are basically 
defined as keeping up with a field of study. Although similar 
examples are used, faculty perceptions of the category in the two 
forms may differ. During the last several t s the Academic 
Personnel Activities Report has been conducteo at the University 
of Michigan, the faculty seem to have viewed the professional develop- 
me> t category as a miscellaneous category. The pilot study 
difference may therefore result from NCHEMS respondents paying 
more attention to the category definition than the Academic 
Personnel Activities Report respondents. 

The results of this study seem to indicate that, though differences 
in the activity categories and definitions between survey instruments 
appear to be small, they can result in significant differences in 
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the reported distributions of faculty activity. For this reason 
an institution must exercise extreme caution in comparing the results 
of its survey with that of another institution. Differences in the 
instrument that may appear to be small may in fact be significant. 
Institutions conducting longitudinal studies on FAA data must also 
be cognizant of the fact that any changes in the form during the 
period studied could significantly affect the results, rendering 
longitudinal comparisons invalid. 

NCHEMS recommends that Institutions be extremely cautious when com- 
paring the data collected on instruments that are different , no 
matter how slight these differences might seem. 
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C. Faculty Acceptanco of a Faculty Activity Survey 



Faculty in different institutions react very differently to an 
activity survey. At some institutions faculty strongly resist 
attempts at collecting activity data and at other institutions 
faculty freely provide the information. The factors that seem 
to influence faculty reaction are: (1) the degree of faculty 
self-governance, (2) the number of times an activity survey has 
been previously conducted, (3) the amount of departmental interest 
in using the collected information for departmental planning, and 
(4) externcil reporting requirements. 

The degree of faculty self -governance has to do with how easily 
faculty can ignore administrative requests. If the faculty are 
a strong governing force within the institution, they must be con- 
vinced that the survey is beneficial for the faculty before they will 
complete the instrument. If, on the other hand, the institution's 
governance is more autocratic, an administration request is taken 
much more seriously. 

If an institution routinely collects activity data, the resistance 
of faculty tends to lessen. Faculty become accustomed to completing 
the survey instrument, and if they discover that no serious consequences 
directly result from the collected information, they are less con- 
cerned about possible misuse of the data. 
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Departmental /unit interest in '.he su. ;ey can plav a st^^ong role in 
how acceptable the survey is to the faculty. If at the departmental 
level the chairman and faculty believe a survey will help in pro- 
moting the department or provide needed information on how the 
department accomplishes its mission, the faculty will be much more 
positive about the survey. 

The external reporting requirements have an effect oh faculty 
response. If the faculty are aware that a central governing 
council for higher education is requiring activity information, 
they will more willingly supply the information than if they 
believe the request is coming from the institution's administration. 

During the pilot test NCHEMS' survey instrument was tested using 
faculty from a wide variety of institutions. The faculty response 
in terms of their comments and the percentage of the faculty who 
were willing to complete the instrument varied greatly. The follow- 
ing paragraphs briefly describe how the survey was accepted at 
each of the pilot test institutions. 
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Appalachian State University - Boone, North Carolina 

Appalachian State University has conducted a faculty activity 
analysis before, but with a very simple form. The institution 
was quite eager to conduct the pilot test to get a more com- 
plete picture of its faculty activities. A total of 374 forms 
were received from 376 faculty in the institution. Some 
administration pressure was applied to faculty who were re- 
luctant to complete the instrument, but generally the faculty 
were cooperative after being briefed about the survey* 

Dartmouth College - Hanover, New Hampshire 

Dartmouth College, a private liberal arts institution, has 
never considered the use of faculty activity analysis 
as part of its institutional management or planning. Twenty- 
two faculty members, distributed among three disciplinary 
divisions (Sciences, Social Sciences, and Humanities), were 
asked to participate in the pilot test of the NCHEMS '^AA 
survey instrument. Each faculty member was asked for an 
appointment to discuss the concepts and uses implicit in the 
pilot test. A survey instrument was left with each respondent 
to be reviewed, completed, and returned to the administering 
office. The faculty were asked to carefully review the 
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relevance of activity categories, to examine the definitions 
of activities, and to try to ascertain if the survey instrument 
permitted them to describe with sufficient accuracy their 
patterns of activity. In short, was the survey instrument 
applicable to a private liberal arts institution? The 
respondents, with some slight suggestions for change, found 
the survey instrument tu be of sufficient comprehensiveness 
and universal applicability to reflect their activit^' n'atterns. 

Florissant Valley Community College - St. i.ouis, Missouri 

Florissant Valley Community College had never conducted an 
activity survey. Faculty at this institution are largely 
self-gcverned and could see little benefit to the faculty 
resulting from an activity survey. The faculty were encouraged 
by the administration via reminder letters and telephone calls 
to complete the survey, but only 40% of the 158 faculty members 
returned a completed survey. 

Michigan State University - East Lansing, Michigan 

Michigan State University has conducted a faculty activity 
survey but does not do so regularly, and therefore their 
faculty were somewhat unaccustomed to such instruments. 
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Three units of Michigan State were selected for the test: the 
College of Communication Arts, Justin Morrill College, and the 
Department of Electrical Engineprinq of the College of Engineer- 
ing. In Justin Morrill College the instrument was administered 
in groups; in the other two units the survey was self-adminis- 
tered. The purpose of the survey was explained in a letter to 
the College of Communication Arts and the Department of Electrical 
Engineering and orally to Justin Morrill College. In Justin 
Morrill College some peer pressure was applied to the faculty 
not wishing to complete the instrument. 

The high response rate for Justin Morrill College and the College 
of Communication Arts is believed to be the result of unit inter- 
est in the results of the survey. 



Unit 



Instruments 
Returned 

% 



Departmert of Electrical Engineering 



61 



Justin Morrill College 



90 



College of Communication Arts 



94 



Overall Response Rate 



86 
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Michigan State also requested the facuHy to complete a 
questionnaire concerning the survey instrument. A tally 
of the results of this survey appears in Appendix B. 

University of California, San Diego - San Diego, California 

The University of California, San Diegc, does not conduct a 
regular activity survey, and faculty are unacc»istomed to com- 
pleting such instruments. Participation of faculty in the 
pilot test was completely voluntary. In the Division of 
Science, the departments surveyed were Chemistry, Physics, 
and Mathematics; in the Soarl Science Division, Anthro- 
pology, Economics, and Psychology; and in the Humanities 
Division, Music, Phil'j:>pphy , and Visual Arts. 

Thrte methods of administering the instrument v.^ere used. An 
interview was conducted with forty faculty, four ranks dis- 
tributed across all nine departments. About 20% of the faculty 
initially contacted for an interview declined to participate; 
the remaining faculty were sequentially invited to participate 
in a group-administered survey until twelve faculty had 
accepted. Those faculty who participated in neither the 
interview nor group-administered surveys were then sent a 
copy of the instrument and asked to complete it. Of these 
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faculty, 18% rasponded. There were no follow-up reminders 
urging completion of the instrument. 

University of Michigan - Ann Arbor, Michigan 

The University of Michigan regularly conducts a faculty 
activity survey. Their faculty are accustomed to completing 
such a survey and response was high. At the University of 
Michigan sixty faculty were randomly selected from the depart- 
ments of English Language and Literature and Electrical and 
Computer Engineering; the entire School of Social Work con- 
sisting of 62 faculty members was also surveyed. Half of 
these faculty completed Michigan's form and half NCHEMS' 
form. The overall response rate varied from 87% in the Depart- 
ment of English Language and Literature to 98% in the Department 
of Electrical and Computer Engineering. The response rate of 
those faculty completing NCHEMS* jurvey was 94%, compared with 
93% for the University of Michigan instrument. 

The faculty using NCHEMS' instrument were informed in an 
accompanying cover letter that their different survey instru- 
ment was part of a pilot test. No additional explanation or 
instructions accompanied the instruments. The numbers of 
calls regarding additional explanations of clarifications, or 
offering critical comments were remarkably few. 
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D. Costs Associated with Conducting a Faculty Activity Analysis 



The cost of conducting a -Paculty survey Can vary greatly depending 
on: 

1. How many faculty are surveyed: The more faculty surveyed the 
greater will be tho cost. 

I. How the instrument is administered: If the instrument is 

administered by an interview technique a great daal of inter- 
viewer time is required and the costs increase substantially. 

3. How the data are analyzed: If the data are extensively 

analyzed personnel and computer costs increase substantially. 

No simple rules can be used to predict to what extent each of these 
factors will affect the cost in any particular institution. If 
a.i institution wislies to estimate the cost of conducting a faculty 
activity analysis, it should consider the cost of the following 
activities: 

Planning Costs: Estimate the time spent by institutional 
personnel in designing changes of the survey instrument and 
planning how to conduct the survey* 
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Printing Cost: Estimate the cost of rraking any desired changes 
in the data collection form and printing copies of the survey 
instrument. 

Cost of Explainii.j Survey to Faculty: Estimate the time spent 
by the institution's personnel discussing the purpose of the 
survey, how it will be conducted, and how the resulting data 
will be used. This cost would be very small where an institu- 
tion has previously conducted an activity survey but could be 
significant if many meetings of faculty are required. 

Cost of Administering the Instrument: Estimate the time spent 
by institutional personnel administering and completing the 
survey instrument. This cost will vary depending on the 
method used: 

A self-administered survey requires about forty-five 
minutes of faculty time the first time the instrument is 
completed. 

A group-administered survey requires about one hour of 
faculty and administration time for each group session. 

An interview requires about one hour of faculty and admin- 
istrative time for each interview. 
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Cost of Completing the Instrumeiit: Estimate the personnel 
time required to complete the fiscal reference block and column 
and the other information block. This time is dependent on the 
availability of the required data and the number of survey 
instruments that must be completed. 

Cost of Data Analysis: Estimate the personnel and computer 
costs of conducting the analysis. These costs will vary with 
the extent of the analysis. The user will be able to consult 
the FAA software documentation for a more complete picture of 
these costs when the software becomes available. 

The cost of the total faculty act'lvity analysis is the sum of the 
individual costs outlined above. Most of these costs, with the 
exception of computer processing and editing, are opportunity costs 
and do not require additional expenditure or budget allocations. 
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APPENDIX A 
DISPLAY OF THE SURVEY INSTRUMENT 



The pilot-tested survey instrument was printed on legal-size paper and 
was identical in format to the instrument appearing on page 103. The 
task force believed this size would make the instrument more difficult 
to lose and therefore would increase the response rate. No evidence 
was collected that would either substantiate or refute this belief. 
No faculty commented positively about the large size but only a few 
were critical . 

The format of the survey instrument is largely an institutional concern. 
There are three principal factors that are likely to influence an 
institution's decision about the format of the survey instrument: 

1, The institution's desire to eliminate specific features of the 
instrument. For example, if the institution eliminates the fiscal 
reference block and column and/or the outcome dimension, the form 
as well as the accompanying instructions must be changed. 

2. The institution's desire to pre-print course information on the 
data collection form. Completing the instrument is more convenient 
if the course information such as course number, credit hours, 
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contact hours, etc., are printed on the form before the form is 
distributed to faculty. If this is done the form must be separated 
from the survey instrument and will necessitate a change in format. 

3. The institution's desire to use an 8 1/2 by 11-inch survey instru- 
ment. A reformatting of the descriptive portion of the instrument 
is required if an 8 1/2 by 11-inch size is used. 

How these format changes are made is an institutional decision. The 
numbers of possible variations are too numerous to attempt to delineate 
in this document. The institution using the instrument must decide 
how the instrument will be formulated but should also keep in mind the 
importance of maintaining an attractive and easily completed instrument. 

The remaining pages of Appendix A contain (1) the entire survey instru- 
ment reduced to 8 1/2 '^y 11 inches, (2) a full-size reproducible copy 
of the data collectior form, and (3) a full-size reproducible copy of 
the additional informaM'on and fiscal reference block. 
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SURVEY INSTRUMENT 
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FACULTY ACTIVITY 
AND OUTCOME SURVEY 



Name Date Academic Term. 

Please address any questions to_ Phone_ 

Upon completion, please detach the form and send it to 



Purpose of Survey 



Use this space for describing the 
purpose of the survey and how the 
collected data will be used. 
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PLEASE READ THE INSTRUCTIONS OX PAGES 3 AND 5 BEFORE YOl COMPLETE THE FORM. 

A sample form is included on papes 6 ;ind 7. 



GENFRAL /NSTRUCTIONS 

ThH survey asks you lo esiinuile the itvemge hours per v^eek thai >ou spend this lerni cnp.igcd in different t\pes of ;iciivii\. 
It «hen asks you to estinuile the percenlngc conlrihution of Ihc^e hours to the outk-onics of the institution. Plose rc;id the 
acivily definitions and examples for ench activity as you complete the survey. 

Before compleiing the form, you miphi find it helpful to nujKe an inituf estmuuc uf the ;i\eragc numhcr of hours you spend 
each vveik in 'his term engaged in professional iiclivittes. Mukmg this estini.itc nuchi help sou diMde sour Time into the re- 
maining section of the survey instrument. 



SECTION A: TEACHING ACTIVITIES 

A.l Scheduled Teaching: All activities related to coiir^<s (degree ;ind nondccree. creclit .md noncrcclii. da> or evening) given in the 
current term. These activities would incUide: 



Meeting informally with 
course participants 



Reading student papers 

Supervising teaching 
issislants 



Supervising these courses 
Meeting scheduled classes Tutoring 
Grading 

Instructions for Columns (a) through (j) 

(a) Do not complete this column. This column will be usad to 
assign a discipline code to each course. 

(b) Enter the department, college, or other unit designation 
under which ihe course is taught. 

(c) Enter the number or other designation for the course and 
section. 

(d) Enter the number of students enrolled and code (R) if 
course material is remedial (below college level) or (E) 
if it is extension (principally directed toward nonmatricu- 
laied students). 

(c/f Enter the number of student credit hours given for cour«. 
In the case of variable credit, give the credit hour range. 

Method of Instruction Colomn (f) 



Supervising independeni 
study 

Giving remedial help 
to conrse participants 

Supervf!ving laboratories 



Evaluating Mudents 
Contacting guest lecturers 
Preparing lectures 
Preparing media 



(f) Enter the method of irstruciion as coded below. When 

multiple methods are used, list them in order of import- 
ance. 

(g) Enter Ihe schedulet' contact hours/ week. 

(h) Enter the average ho.irs/week of unscheduled contact with 
students in course. 

(i) Enter the iiverage hours/week spcni in preparing and ar- 
ranging the activities of the current course. 

(i) Enter the total average hours/ week [sum of columns 
(g). (h), and { I ) in Section A. 11, 



Code 


Method 


Definition 


A 


Lecture 


Fc-m"! presentation — primarily one-way communication 


B 


Laboratory 


Instructing, preparingv and supervising Mudent investigations 


C 


Recitation/ Discussion 


Two-way communication of course materials 


D 


Seminar 


Students carry the major responsibility for preparation 


E 


Independent Study 


Students work independently with only minimal faculty direction 


F 


Tutorial 


Students work one-to-one with Ihe instructor 


G 


Programmed Instrucliao 


Course contents presented 'hrough programed materials 



A. 2 Unscheduled Teaching: Teaching not associated with the specific courses listed in A.]. For example. 

Thesis committee participation Guest lecturing in another faculty mcnber's course 

Thesis advising Giving seminar?! wiihin the Institution 

Discussions with colleagues about teaching 

A»3 Academic Program Advising: Giving advice to uudenls concerning course scheduling ^nd iicadcniic programs. Not to be confused 
with counselmg that is included in C.I. 

A.4 Course and Curriculum Research and Development: Developing and preparing for future courses. For example: 



Preparing course outlines 
Developing book lists 
Ev.iluaiing courivcs 

Level Codes Column <p) 



Devising new instruciioniil materials 

Revising existing materials 

Planning summer or inierscssion 
programs 



Developing department 
curriculum reqiiiremenls 

Evaluating teaching effectiveness 
and phinninc changes 



Cude 


Description 


Code 


Description 


A 


Preparatory 


E 


Upper division and graduate 


B 


Lower division 


F 


Graduate 


C 


Upper division 


G 


Professiortai 


D 


Undergraduate 


H 


Other 
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OUTCOME DEFINITION 

This section of the form allows ynu to indicate what outcomes your activities principally benefit. Please try to make a rough estimate 
of the percentage distribution for each of your aclvities to the followng outcomes: 



(k) Student Growth and Development: Results and benefits of 
activities that contribute to enhancing persona^ social^ aca- 
demic and or career aspects of students who are registered 
in the institution. 

(1) Development of New Knowledge and Art Forms: Results 
and benefits of activities that contribute to the development, 
storage, utilization, and ^ or appreciation of knowledge and 
art in society. 



(ni) Community Service and Development: Results and benefits 
of activities that contribute to educational growth In and 
provide short- or long-term utility to the non-academic 
community. 

(n) Inseparable Combination of (k) 4- (I) 4- (m): Results and 
benefits of activities that contribute to student growth and 
development creation of new knowledge and art forms, and 
community service and development and cannot be sepa- 
rated. (It is preferable to separate these if possible.) 



COLUMN (O) 

(o) Do not complete this column. This column will be used to link account cndes to reported activities. 
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LEVEL OF ADMINISTRATIVE AND COMMITTEE ACTIVITIES 



Code 
!. . . . 
2.... 
3.. . . 



l.evel 

Department/ Unit 
College/School/ Division 
Campuswlde 
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I'l.KASK RK VI) tin: INSTRK TU>\S OS I1IIS AS \ Ol ( (VMI»I.K I>: I UK I'ORM TO illK l EH 



S^:CI10N B; KlrSKAKCH, SC I lOI A K SI II IV AM) C KI-AIK WORK At TIVII Il-S 

"•1 Spi'ciftc f'rojccts- Kcsc;((th. ,>nd crciiti^L: ^^ork iictisrh icf.iti'tl to .( sp/i. ifn.- pf (i/itf I ot f\,iriip(L* 

IX'piirliiK'ntiil I'trstMrcIt Ucvcwini; ;i c()llo;tj;iio\ Giving rccit;ils VS riiiny 

Sponsorx'j.! it'sciirvh M ;iinl;iininij ;in ;irlistit; CriMliiiK now .iti forms 

„ , Wrilinu or L'Uininu skill 

-Pcrforrnint: your . , |-\hihiiuiiis 

prmcsstonni skill WnHniJ iiriiclcs 

^ ,. . . AJniinisUTint! research , . 

Vour liisscrrtjilfdn rcstMrch VVrjtmc hooks 
grani> 

B.2 {iciK'r;il St'hDLirship unil PfOfcssiiin:il DcvL-loptucni ; All il'sciicIi. >».hnl;irship. ,irn.l lic;iIi\i.' work in.iiviiics ii.-|,ilcil lo keeping ciir- 
rem in ;i prnfcssioniil Jickl. I'ln cximiple: 

Kcadinij iirlicK's :inil Officer in ji profcssuiniil Aticniliny scininsirs Tdiiur of ii joiiiniil 

ln)<)1s,s rt'kik'd lo vour society 

profession Rcsc;uch-rcli,lc,l Jiscusmoji 

Alicniling pjofcssinnii) wilh collcajiiics 
mcclinps 



SECTION C. INTF.RNAI. SHRVICI- ACTIVJTIHS 



this scclinn HK'lHLk's ia'livtiiL's rcliited lo i;oncr;il i.'tini;iet wiih simtcnts. lo profcssumiil rcspnnsifMhi 
iinils uilhin lilt: insiiuiiion. ;imj lo tnllillinj: mstiniioniii rfLiii^'sSs 



CI StiKk'nlMiricnk'tl ScrtiLC : l or cxiimpk' : 



Personal, tiirt'cr, nnd 
fin;mci:il counsel in^; 

Prep;»riiig rcconuncndii lions 

PiirttL'ipnlion in sociiil 
in I c ruction 



Kccniiiing siiidcnis 
Sponsoring student org;ini/;iiions 
Meeting with parents 
Anendint; sUkleni rcciiitis 



C'ojiching inlraniiir;if or 
inlercnllci:iiilc iilhk-ncs 

niic;:ifny ihe hjind. orchestra, 
siudcnl phiys, ^Ic'baic tcnin. or 
;inv olher siudcnt iiroiip 



ilhin tithe r or|:;itii/iiiion;i| 



C.2 Adniinisirjiinc Dulies: Por cx;unplc : 

Pcrfoiminy Ihe dmics of u 
depnrtnicni ch:urin;in. dciin, 
vicL'-presidcnt or ;my oihi-^r 
;i(lniinisli;)livc posit^)n 

AdniinistL-rmi: personnel 
policieN 



J';iciiliy sLMviL'e i\.'poris .iikI 
qUesiionn.iircs 

Keeping recortis 

Prepiiring nuniites 

VVriiing ;ini.i unsvi-cring 
nicmonmdii 



C.3 Coniniitice P;irlii:ip;i|ion. For c.\;iniplc: 

Admission coinniiitecs I'aciihy scnale 

IX'parinJcnt:)) i)iei.'iini."» PJanninj: con) njjj tees 



Assij;ninn f.icnliy voiirsc loads 

Prcparini: huUpcK 

Cfalhcrintz (.lata 

Hclpint' liwrine rffistraiion 

Inicrvicainp can^liilaio for 
faculty posiiions 

liudgi:! cuniniiiiees 



Hscortin^! visitors 
Recrutiing faculi> 
Advising on lihiary purchases 
Kcc rdftinp stiuk'nls 



Code the level of ihcsc acii vines :is described ^ii the fool nf ilic form, 



SECTION |>r PUBLIC SIIRVICF. ACTIVITIHS 

n«is scciion includes nclivino ih^U are directed oiiiside the insiitnlion jexeept tor those associaied v^ith conununiiy educ;nion 
'txlension instrueiion ) . which should be inchlJcd in A.I.]. 

General Prolessional Services Advice I!) i reeled Outsido the InMiiaiion: Aclivities meant to hcnefii Hic comnnmiiy on hide ihc 
insiiiucion. For c.\anip|e; 

Consulliji!; C"oniiiuinity training grams Agricultural exiension 

^t'^'-'i'ni: Patient care Urbnn extension 

Professionally performing; Lectures or seminars for 

as in pl;i>s, orchestras ihe public 



ERIC 



5 

109 



tOK INSIIII IIO> \l I Si 



I) (W M.t l\( SH I Kin >(). 



Sli HON \ tl M M>NC. \( ll\||||S 




I'l KC 1 N 1 \(,l DIS 1 KIRl 1 1(» 
10 INSMII IHtN \l (II M OMIS 


\. 1 S< HI 1 II) l> \C ){|>C, 


Hi 

XMK\{.I 
IIOI KS 
>-|K 


(kl 

5^ 
*7 


Ill 

** X i 

PA 

- / c 


7^i 




H I/; 

"7= 


<iil 

II Ml IS 

On not 
wrili- in 
lh>> (otuiiiii 


(hi 
I Mi 


( Ol RSI & 
S|( HON • 


Id) 
sic HON 


In 

( Ml l>ll 
MOl KS 


in 

\|| IH(M) 

Oh 
INSI Kt C ■ 
IICIN 


iKl ^ tht 4. tt> s Ijt 


1 nrnll- 
mint 


C Ldf 

R if Kciiii-ilul 
1 if 1 \lrn.ji<ii 


• HI 
lOK^f \i 
C C)> 1 \< 1 
IU)\ KS 


Iht 
(MMIK 
C i>> 1 \C I 
tUH KS 


\ > 

I'R* 1' \K- 
\ 1 ION K 
M>MIN. 
ISIR \M(» 






424-1 


17 


E 




D . 


J 


J 


5. 5 


11.5 














CHEM 


425-1 


74 






A 


0 


J 


i. 0 


6.0 














CHEM 


425-4 


17 




3 


B/C 






5. 


12.0 




76 










CHEM 


491 


8 




1 


E 


2 


4 


2. 5 


8.5 














































































































































































































SI BT01 Al 








38.0 







ipi 
1 1 \|l. 


IMI 

\( ll\ 1 1 > 01 s( Kll'l ION 














i.f 1 >S( HI t>l 1 l.l> 

II \( Ul^<' 


c 


Student Discussion 




100 


























\( \l>l.\lU 
t'KO(.R\M 
.\l>\ IMN(, 


E 


Graduate Student Advising 


'>,.0 


100 










B 


Entering Freshmen Advising 


1.5 


100 










\.4 ( 01 KSI. \M) 
( ( RRK 1 1.1 M 
Ri:s. 1 l>| \ll OP. 




Course Outline-Solid Polymers Course 


1.5 


70 


30 
























S\ HIOI M 


5.0 





6 

er|c 







r\m \w DisiRisi itov 

lO IVSllll ll(*\ M Ol K OSUS 


r /' 
i Z 
/I 

z7 


/ -at 

57 « 

< " - 


^ - / 
7 

- * 1 


/ 

a 

I i 
S 

ae « 

1 / 
/ = 


7 / 
* 

^ X r 
X " - 

"7 = 


\( 1 1\ II \ M 1 -\ 1 1 \ l>^S( Min KIV 


s 


B.l II l( fttOJ^f IS 


Institute for ''lat.un^jls J^esccpcm 


5. 5 


40 


60 








:JSF 02163 


4. 


50 


50 








Wr-itinj F Che'v. Text 


I. 0 


50 


50 






















R.2 (.1 M^H \l 

S( HOI xMMIir \M) 

rHOI ^SSMIN M l)MMni'\UM 


Heading Journals S Favevs 


4. 0 


50 










Attending Professioyial Meetings 


. 6 








































SI HHM M 


lb 





Cir 


I .I Sll n^N 1 OH II- M H> 
H\ l< 1- 


























































( oni- 1 |-\M 


i .2 \I)MIMS|R \ 1I\K 
1)1 ti^s 


i 


Conpleting Fo'^'vs 


. 5 








JOG 




















































< .} ( OMMII IKK 

r\RIKlt>\llON 


3 


Pres. Candidate Select. Corm. 


1. 5 








TOO 




I 


Fac. Candidate RevieV' Comm. 


U Z 








100 
































\ 




SI RIOI M 


3.5 





t £ 


(.KNliRXl PROfKSMON \ 

si:r\i(>: \i)M( i- DiRi-ct^i) 

Ol IMOK IIIK INMin HON 


Consulting to iJIH 


i. 5 




100 






































si hlOl \l 


2,5 





63 



ERIC 



7 

111 



COMMENTS 



DATA COLLECTION FORM 



ERIC 



113 



NAMt. 



I.I). «R MK I \l. NM I RIIV NO. 



SK HON \: {K\( HIN(; \( ilMIIKS 




I'l K( KNI \<.| DiSIRIIU HON 
lO INSI Ml n(»N \i 01 K OMKS 


A. 1 MM KIM rKI> II.A( lilN(; 


(j> 

a>>.ra<;k 

not RS 

I'KR 
U Kt.K 


<VI 


Hi 

pi 

c/ ^ 


<m) 

H 

C7i: 

w •■r. S 


(MP 

as " 




(ol 


i>i> nut 
v*rili' ill 
this column 


(to 

IlKPI. 
IN II 


Ul 

( Ol RSK & 
SK( HON » 


((11 
SH HON 


iv) 

( RhOII 
MOl KS 


if) 

Ml 1 MOO 
01 

INMRIC- 
t ION 


iK\ ih) 4- <il = 'ji 


Knrnll. 
ini>nt 


( ttilv 
R if Riinidiul 
K if Kxtiiivi4>n 


KORMM 
(ONI At 1 
IKH KS 


(h) 
OIMKR 
fON 1 \(l 
tt(H RS 


<i) 

PKt l* \R. 
\ 1 ION a 

\nMiN- 

ISI R \ HON 


























































































































































































































































































































































SL] 


BTOIAI. 





















ERIC 





I.KMJ. 


A("ii\m i>Ks< RiriiuN 
















\.2 I NSt MKDl I>;t> 
I>:At'IIING 






































vJ \C \l)hMI( 

pko(;r\m 

AI>\ iSINt; 






































A.4 t Ol RSK ANI> 
C I RRK I lA M 
RKS. & OKN tl Or 






































114 


SI BIOI \i 









\\H R\(,l 
IIOI RS 

I'KR 
WtF K 


rHR( FM \(.K DISIRIBI HON 
lO INSIIII 'ION M Ol |( OMKS 


(kl 

= / 

X Z 

/ 1 
r 

r* 


Ml 

C J £ 

- ^ 
1^ c — 

2,/ " 


\\\\\ 

z / 

— i ««• 


(111 

X _ 

✓ - 


7 / 

n 2 s 

ac 

— ~ — 
** 7 - 


(q) 

\( ll>IIY \C II\II " |)FS( RirilON 


X 


B.I SPH II K I'ROJH IS 


























































B.2 C.hSKKM 

S( IIOI \RSIIII* \M) 

PROI KSSION \l l)K> h r OI'MI N I 




























































M IIIOI \i 
















X 

Chip 


< -I SI I l)KM-(>RIK\ 1 Kl) 

skrvkt: 


























































( ODK 1 K\ H i 


('.2 \I)MIMSIR\M\K 
1)1 TIKS 


































































(•-3 ( OMMI I I KK 

I'ARIK lI'M ION 






































































SI BIOI \l 







c 2 


c;ener\i. i'rokessionai. 
sermc e \i)mc e dirkcted 

01 TSIDK I IIK INS I 1 1 1 I ION 














































SI BIOI Al 







O 115 

ERIC 



\> KR\(,K MRS »tKK 



ADDITIONAL INFORMATION AND FISCAL REFERENCE BLOCK 





)III()N \l 


IM ORM \ 


||()\ Bl ()( K 






1 ISt \r, RH>RK\( V Bl <)( K 


INS inn ION 


^. 
X 

'Ji 


X 


c 


/ 


? 5 


r 

X 

1 -X 
< X 


;^ 
/■ 
*• 
ae 
>• 


o 

z £ 






ACCOUNT 
TITLE 


LMT 


PCS 
CODE 


ACCOINT 
NLMBtR 


SAL\RY 
IMJI I \RS 



































116 



APPENDIX B 
DEVELOPMENT OF THE SURVEY INSTRUMENT 



The survey instrument was developed over approximately a two-year period. 
Most of the previously developed instruments and research studies were 
evaluated by the NCHEMS staff and the FAA Task Force. The result of these 
evaluations was a survey instrument that appeared to possess the better 
features of many of tha previous instruments and that could serve as a 
general activity survey instrument for a wide variety of institutions. 
The instrument was pre-pilot tested during the summer of 1972 by thirty 
faculty in each of five institutions. The participating faculty and 
representatives from the pilot test institutions recommended that the 
instructions for the instrument be considerably reduced and that some 
of the activity and outcomes categories be combined. The recommended 
changes were incorporated into the version of the instrument that was 
pilot tested by approximately 1,200 faculty in the fall academic term 
of 1972. After evaluating the pilot study, two additional chang'js were 
made to the instrument. Several of the acti/ity categories were combined 
into administrative duties, and the outcomes categories were condensed 
by eliminating general institutional servica and personal professional 
growth. These two outcome categories were not considered ultimate 
institutional outcomes, and includin:: them obscured the distribution 
of activities to the ultimate outcomes of the institution. 
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The following is a response by Michinan State University faculty to the 
pilot-tested version of the survey Irstrument, The responses and comments 
of the faculty may help an institution in anticipating the types of prob- 
lens faculty will have in completing the survey. The questionnaire is 
separately displayed for Justin Morrill College, the Department of 
Electrical Engineering, and the College of Communication Arts. Please 
note that the responses in the College of Communication Arts are those of 
the graduate assistants. 



ERIC 



RESPONSES TO QUESTIONS ON 
NCHEMS' FACULTY ACTIVITY AND OUTCOME SURVEY: 
INSTRUMENT CRITIQUE-FACULTY 



MICHIGAN STATE UNIVERSITY 
(Justin Morrill College) 



RESPONDENTS 

4 Professors 

4 Associate Professors 
10 Assistant Professors 

8 Instructors 
26 Total 



SECTION I: ACTIVITY CATEGORIES 



1. IN GENERAL, DID YOU FIND THE DEFINITIONS OF THE ACTIVITY CATEGORIES 
UNDERSTANDABLE? 

25* Yes 
1 No 

IF NOT, WHICH ONES WERE NOT CLEAR AND WHY? 

There seemed to be some crossover— difficult to separate. 

2. ARE THE ACTIVITY CATEGORIES LISTED ON THE INSTRUMENT THOSE WHICH 
ARE MOST IMPORTANT TO YOU? 

22 Yes 
3 No 
1 Omit 



♦Figures on the left indicate number of respondents unless noted otherwise. 
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3. DO THE "METHODS OF INSTRUCTION" USED IN THE SCHEDULED TEACHING 
SECTION ADEQUATELY DESCRIBE THE GENERAL INSTRUCTIONAL METHODS YOU 
UTILIZE? 

20 Yes 
4 No 
2 Omit 

4. WHAT IS YOUR ESTIMATE OF YOUR TOTAL AVERAGE WORK HOURS PER WEEK? 

2 21-40 hours 
5 41-50 " 

4 51-60 " 

9 61-70 " 

3 71-80 " 
L 81-90 " 
1 91-100 " 

DOES YOUR ESTIMATE OF TOTAL HOURS PER AVERAGE WEEK APPEAR TO BE 
REALISTIC? 

23 Yes 
2 No 
1 Omit 



SECTION II: PERCENTAGE DISTRIBUTION TO INSTITUTIONAL OUTCOMES 



5. ARE THE CATEGORIES OF INSTITUTIONAL OUTCOMES MEANINGFUL TO YOU? 

16 Yes 
9 No 
1 Omit 

6. HOW DIFFICULT WAS IT FOR YOU TO DISTRIBUTE YOUR HOURS ON A PER- 
CENTAGE BASIS TO THE VARIOUS OUTCOME CATEGORIES? 

10 Difficult 
12 Not difficult 

3 Cannot tell 

1 Omit 
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SECTION III: COMPLETING THE SURVEY INSTRUMENT 



7. HOW LONG DID IT TAKE YOU TO READ AND UNDERSTAND THE INSTRUCTIONS 
AND DEFINITIONS, AND FILL OUT THIS QUESTIONNAIRE? 

2 0.50 hours 

2 0.75 " 

5 1.00 " 

6 1.25 " 

6 1.50 " 
1 1.75 " 

3 2.00 " 
1 Omi t 

8. IN ORDER TO BEST DESCRIBE YOUR ACTIVITIES DURING A GIVEN TERM. WHEN 
DURING THE TERM SHOULD THIS SURVEY BE CONDUCTED? 

0 At the beginning 

7 At mid- term 

18 Just prior to the end of the term 

1 Other 

9. WHAT ARE SOME WAYS OF GETTING A REALISTIC DESCRIPTION OF YOUR ACTIVITIES? 

3 Sending questionnaire directly to faculty without advance 
notification 

17 A faculty should be notified in advance to keep calendar 
wi th knowledge of the form 

3 A faculty should be notified in advance to keep calendar 
wi thout knowledge of the form 

1 Other (don't know) 

2 Omit 
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10.. HOW FREQUENTLY SHOULD THIS TYPE OF FORM BE ADMINISTERED? 

13 Once a year 

0 Quarterly 

9 Other--Every 4 years 

--As infrequently as possible 
— As needed, when necessary 
— Once every few years 
--Biannual ly 

—Only as required to keep intruders at bay 

2 Never 

2 Omit 

11. HOW WOULD YOU PROPOSE TO HELP VALIDATE THIS QUESTIONNAIRE? 

10 Faculty are responsible for completing the form, thus 
it needs no further action 

1 Have unit administrator review it 

5 Have faculty committee from the unit or college review it 

3 Have dean of the college review it 

6 Other 
3 Omi t 

12. HOW WOULD YOU RECOMMEND THIS FORM BE USED? 

6 Personal communication to department chairman and/or dean 

2 Consideration of salary 

2 Consideration of promotion 

2 Consideration of tenure 

3 Basis for future assignment 

16 Institutional communication to legislature 

12 Individual data should not be used, only aggregates of data 

2 Other 

1 Omit 

13. WHAT ARE SOME WAYS IN WHICH YOU THINK THE INSTRUCTION BOOKLET COULD 
BE IMPROVED? 

Instruction booklet pretty adequate* 

Apply to entire year--not one term 

It is probably impossible to "improve" such a misconceived 
"survey": Who can really estimate how this time and thought 
is divided, or who can insure the honesty of even the guesswork? 

There is no average week. What about a log form? 

Can't think of any 



*Relatively high frequency. 
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14. HOW WOULD YOU IMPROVE THE SURVEY INSTRUMENT ITSELF? 

First decide what purpose it serves, then communicate findings 
to the respondents 

Some additional categories specifically appropriate to the 
special activities of a residential college; e.g., team 
teaching, unusual course arrangements, community building 
activities with other faculty and students 

Insufficient knowledge of the field 

This is a pretty good instrument 

Don't know 
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RESPONSES TO QUESTIONS ON 
NCHEMS' FACULTY ACTIVITY AND OUTCOME SURVEY: 
INSTRUMENT CRITIQUE—FACULTY 



MICHIGAN STATE UNIVERSITY 
(Department of Electrical Engineering) 



RESPONDENTS 

3 Professors 

4 Associate Professors 
7 Assistant Professors 

14 Total 



SECTION I: ACTIVITY CATEGORIES 



1. IN GENERAL, DID YOU FIND THE DEFINITIONS OF THE ACTIVITY CATEGORIES 
UNDERSTANDABLE? 

12 Yes 
1 No 

1 Omit 

2. ARE THE ACTIVITY CATEGORIES LISTED ON THE INSTRUMENT THOSr: WHICH ARE 
MOST IMPORTANT TO YOU? 

12 Yes 

2 No 

3. DO THE "METHODS OF INSTRUCTION" USED IN THE SCHEDULED TEACHING SECTION 
ADEQUATELY DESCRIBE THE GENERAL INSTRUCTIONAL MtTHODS YOU UTILIZE? 

13 Yes 
1 No 
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4. WHAT IS YOUR ESTIMATE OF YOUR TOTAL AVERAGE WORK HO'JRS PER WEEK? 



31-40 hours 

4 41-50 " 

3 51-60 " 

4 61-70 " 
2 Omit 

DOES YOUR ESTIMATE OT TOTAL HOURS PER AVERAGE WEEK Al PEAR TO BE 
RLA'.ISTIC? 

12 Yes 

1 No 

1 Omit 

SECTION II: PERCENTAGE DISTRIBUTION TO INSTITUTIONAL OUTCOMES 

5. ARE THE CATEGORIES OR INSTITUTIONAL OUTCOMES MEANINGFUL TO YOU? 

9 Yes 
4 No 
1 Omit 

6. HOW DIFFICULT WAS IT FOR YOU TO DISTRIBUTE YOUR HOURS ON PERCENTAGE 
BASIS TO THE VARIOUS OUTCOME CATEGORIES? 

9 Difficult 
4 Not difficult 
1 Cannot tell 

SECTION III: COMPLETING THE SURVEY INSTRUMENT 



7. HOW LONG DID IT TAKE YOU TO READ AND UNDERSTAND THE INSTRUCTIONS 
AND DEFINITIONS, AND FILL OUT THIS QUESTIONNAIRE? 



4 


0.50 


hours 


0 


0.75 


II 


2 


1.00 


II 


0 


1 .25 


II 


2 


1.50 


II 


0 


1.75 


II 


4 


2.00 


II 


0 


2.25 


II 


1 


2.50 


II 


1 
1 


> 2.50 


II 



Er|c 126 



8. IN ORDER TO BEST DESCRIBE YOUR ACTIVITIES DURING A GIVEN TERM, 
WHEN DURING THE TERM SHOULD THIS SURVEY BE CONDUCTED? 

0 At the beginning 

1 At mid-term 

11 Just prior to the end of the term 

2 Other — Never 

9. WHAT ARE SOME WAYS OF GETTING A REALISTIC DESCRIPTION OP YOUR 
ACTIVITIES? 

3 Sending questionnaire directly to faculty without advance 
notification 

8 A faculty should be notified in advance to keep Calendar 
with knowledge of the form 

0 A faculty should be notified in advance to keep calendar 
without knowledge of the form 

3 Other-- Any of the above should do 

— Suggest you get less vague form 

— You read a calendar kept by faculty 

1 Omit 

10. HOW FREQUENTLY SHOULD THIS TYPE OF FORM BE ADMINISTERED? 

7 Once a year 
? Quarterly 

3 Other ~ Depends on its purpose and impact 

— - Higher accuracy requires higher frequency 

2 Omit 

11. HOW WOULD YOU PROPOSE TO HELP VALIDATE THIS QUESTIONNAIRE? 

6 Faculty are responsible for completing the form, thus it 
needs no further action 

3 Have unit administrator review it 

2 Have faculty committee from the unit or college review it 
0 Have dean of the college review it 

3 Other— Not possible 

— If there is a question, the faculty member and his 
department chairman can try to resolve it 

2 Omi t 
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12. 



HOW WOULD YOU RECOMMEND THIS FORM TO BE USED? 



5 Personal communication to department chairman and/or dean 
1 Consideration of salary 
1 Consideration of promotion 

0 Consideration of tenure 

3 Basis for future assignment 

3 Institutional communication to legislature 

5 Individual data should not be used, only aggregates of data 

4 Other 

13, WHAT ARE SOME WAYS IN WHICH YOU THINK THE INSTRUCTION BOOKLET COULD 
BE IMPROVED: 

Forget it 

Seems okay 

1 don't think this evaluation gives an accurate evaluation of 
one's research and publications 

14, HOW WOULD YOU IMPROVE THE SURVEY INSTRUMENT ITSELF? 

Follow up with personal contact between chairman and faculty 
member 
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RESPONSES TO QUESTIONS ON 
NCHEMS' FACULTY ACTIVITY AND OUTCOME SURVCY: 
INSTRUMENT CRITIQUE— GRADUATE ASSISTANTS 



MICHIGAN STATE UNIVERSITY 
(College of Communication Arts) 



RESPONDENTS 

1 Assistant Instructor 
43 Graduate Assistants 
_2 Other 

46 Total 



SECTION I: ACTIVITY CATEGORIES 



1. IN GENERAL, DID YOU FIND THE DEFINITIONS OF THE ACTIVITY CATEGORIES 
UNDERSTANDABLE? 

35 Yes 
11 No 

2. ARE THE ACTIVITY CATEGORIES LISTED ON THE INSTRUMENT THOSE WHICH 
. ARE MOST IMPORTANT TO YOU? 

35 Yes 
9 No 
2 Omi t 

3. DO THE "METHODS OF INSTRUCTION" USED IN THE SCHEDULED TEACHING SECTION 
ADEQUATELY DESCRIBE THE GENERAL INSTRUCTIONAL METHODS YOU UTILIZE? 

39 Yes 
7 No 
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4. WHAT IS YOUR ESTIMATE OF YOUR TOTAL AVERAGE WORK HOURS PER WEEK? 



8 0-10 hours 

7 11-30 " 

8 21-30 " 
1 31-40 " 

5 41-50 " 

6 51-60 " 



2 61-70 hours 

1 71-80 

2 81-90 

0 91-100 " 

1 Over 100 ''■ 
5 Omit 



DOES YOUR ESTIMATE OF TOTAL HOURS PER AVERAGE WEEK APPEAR TO BE 
REALISTIC? 



31 Yes 
8 No 
7 Omit 



SECTION II: PERCENTAGE DISTRIBUTION TO INSTITUTIONAL OUTCOMES 



5. ARE THE CATEGORIES OF INSTITUTIONAL OUTCOMES MEANINGFUL TO YOU? 

25 Yes 
18 No 
3 Omi t 

6. HOW DIFFICULT WAS IT FOR YOU TO DISTRIBUTE YOUR HOURS ON A PERCENTAGE 
BASIS TO THE VARIOUS OUTCOMES CATEGORIES? 

21 Difficult 
20 Not difficult 
5 Cannot tell 



SECTION III: COMPLETING THE SURVEY INSTRUMENT 



7. HOW LONG niD IT TAKE YOU TO READ AND UNDERSTAND THE INSTRUCTIONS 
AND DEFINITIONS, AND FILL OUT THIS QUESTIONNAIRE? 



18 0.50 hours 2 1 .50 hours 

8 0.75 " 1 1.75 " 

10 1.00 " 2 2.00 " 

4 1.25 " 1 Omit 
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8. IN ORDER TO BEST DESCRIBE YOUR ACTIVITIES DURING A GIVEN TERM, WHEN 
DURING THE TERM SHOULD THIS SURVEY BE CONDUCTED? 

0 At the beginning 
6 Mid-term 

37 Just prior to the end of the term 

2 Other—After at least a year on the job 

1 Omi t 

9. WHAT ARE SOME WAYS OF GETTING A REALISTIC DESCRIPTION OF YOUR ACTIVITIES? 

16 Sending questionnaire directly to faculty without advance 
notification 

22 A faculty should be notified in advance to keep calendar 
wi th knowledge of the form 

3 A faculty should be notified in advance to keep calendar 
without knowledge of the form 

5 Other--I really do not appreciate this form as a meanr of 
getting a realistic description of my activities 

10. HOW FREQUENTLY SHOULD THIS TYPE OF FORM BE ADMINISTERED? 

20 Once a year 
14 Quarterly 

9 Other--At the end of spring quarter 
— Fall and spring 
—Depends upon research goals 

1 Never 

2 Omi t 

11. HOW WOULD YOU PROPOSE TO HELP VALIDATE THIS QUESTIONNAIRE? 

17 Faculty are responsible for completing the form, thus it 
needs no further action 

8 Have unit administrator review it 

4 Have faculty committee from the unit or college review it 

1 Have dean of the college review it 

11 Other— Have students review it 
—Use sub-sample 

5 Omi t 
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12. 



HOW WOULD YOU RECOMMEND THIS FORM TO BE USED? 



17 Personal communication to department chairman and/or dean 

2 Consideration of salary 

3 Consideration of promotion 

1 Consideration of tenure 

10 Basis for future assignment 

11 Institutional communication to legislature 

25 Individual data should not be used, only aggregates of data 
3 Other--To evaluate the department or college r^ctivities, 
not the individual 
—I cannot imagine any useful ness-theref ore, I would 
not recommend 

2 Omi t 

13. WHAT ARE SOME WAYS IN WHICH YOU THINK THE INSTRUCTION BOOKLET COULD 
BE IMPROVED? 

None— it was OK! 
Color code 

Delete percentage distribution to institutional outcomes 

14. HOW WOULD YOU IMPROVE THE SURVEY INSTRUMENT ITSELF? 

Not relevant to graduate assistant 

Place a list distribution of grades given in course taught 

Give background for reason for study, especially concerning 
"percentage distribution to institutional outcomes" 

Use different form for graduate assistant 
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